-- Logs begin at Sat 2022-10-15 13:10:14 UTC, end at Sat 2022-10-15 14:04:24 UTC. -- Oct 15 13:33:58.925264 dv-cinder-861491-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 15 13:33:58.934596 dv-cinder-861491-3-smb devstack@keystone.service[87865]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 15 13:33:58 2022] *** Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: nodename: dv-cinder-861491-3-smb Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: machine: x86_64 Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: clock source: unix Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: pcre jit disabled Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: detected number of CPU cores: 4 Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: current working directory: / Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: detected binary path: /usr/bin/uwsgi-core Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: your processes number limit is 47680 Oct 15 13:33:58.936731 dv-cinder-861491-3-smb devstack@keystone.service[87865]: your memory page size is 4096 bytes Oct 15 13:33:58.937361 dv-cinder-861491-3-smb devstack@keystone.service[87865]: detected max file descriptor number: 2048 Oct 15 13:33:58.937361 dv-cinder-861491-3-smb devstack@keystone.service[87865]: lock engine: pthread robust mutexes Oct 15 13:33:58.937361 dv-cinder-861491-3-smb devstack@keystone.service[87865]: thunder lock: enabled Oct 15 13:33:58.937361 dv-cinder-861491-3-smb devstack@keystone.service[87865]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 15 13:33:58.937361 dv-cinder-861491-3-smb devstack@keystone.service[87865]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 15 13:33:58.977213 dv-cinder-861491-3-smb devstack@keystone.service[87865]: Python main interpreter initialized at 0x55a2ea22d9c0 Oct 15 13:33:58.977213 dv-cinder-861491-3-smb devstack@keystone.service[87865]: python threads support enabled Oct 15 13:33:58.977213 dv-cinder-861491-3-smb devstack@keystone.service[87865]: your server socket listen backlog is limited to 100 connections Oct 15 13:33:58.977213 dv-cinder-861491-3-smb devstack@keystone.service[87865]: your mercy for graceful operations on workers is 90 seconds Oct 15 13:33:58.977589 dv-cinder-861491-3-smb devstack@keystone.service[87865]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 13:33:58.977589 dv-cinder-861491-3-smb devstack@keystone.service[87865]: *** Operational MODE: preforking *** Oct 15 13:33:58.977871 dv-cinder-861491-3-smb devstack@keystone.service[87865]: *** uWSGI is running in multiple interpreter mode *** Oct 15 13:33:58.977871 dv-cinder-861491-3-smb devstack@keystone.service[87865]: spawned uWSGI master process (pid: 87865) Oct 15 13:33:58.978096 dv-cinder-861491-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 15 13:33:58.980796 dv-cinder-861491-3-smb devstack@keystone.service[87865]: spawned uWSGI worker 1 (pid: 87877, cores: 1) Oct 15 13:33:58.980796 dv-cinder-861491-3-smb devstack@keystone.service[87865]: spawned uWSGI worker 2 (pid: 87878, cores: 1) Oct 15 13:33:58.980796 dv-cinder-861491-3-smb devstack@keystone.service[87865]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 13:34:03.304568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:34:03.304568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: from cryptography.utils import int_from_bytes Oct 15 13:34:03.305424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:34:03.305424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: from cryptography.utils import int_from_bytes Oct 15 13:34:03.305859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:34:03.305859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: from cryptography.utils import int_from_bytes Oct 15 13:34:03.305978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:34:03.305978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: from cryptography.utils import int_from_bytes Oct 15 13:34:03.355470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:34:03.355692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:34:03.355769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:34:03.355944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:34:03.355944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] command line args: [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:34:03.356059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] command line args: [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:34:03.356190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:34:03.356272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:34:03.356331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ================================================================================ {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:34:03.356393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ================================================================================ {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:34:03.356587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] admin_token = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.356696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] admin_token = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.356837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] config_dir = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.356917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] config_dir = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] config_source = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] config_source = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] debug = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] debug = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.357961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.358977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_config_append = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_config_append = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_dir = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_dir = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_file = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_file = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.359950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.360900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.361931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.362994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.363594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.363682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.363758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] publish_errors = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.363996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] publish_errors = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.364871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] standard_threads = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] standard_threads = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.365887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] use_journal = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] use_json = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] use_journal = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] use_stderr = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] use_json = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] use_syslog = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] use_stderr = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] use_syslog = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:34:03.366923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.367907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.368829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369333 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369490 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.369955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.370991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.371992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.372972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.373894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.374843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.375960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376427 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.376883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.377884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.378818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.379847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380709 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.380941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.381961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.382884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.383904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.384986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.385930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386709 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.386937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.387918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.388869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.389958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.390961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.391931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.external = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.external = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.392906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.password = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] auth.token = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.password = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.393875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] auth.token = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.394793 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.395859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396490 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.396968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.397935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.398997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.399924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.400955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.401899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.402943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.403985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.404926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.405941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.406925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.407896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.408984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.409949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.410903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.411952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.412958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.413986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.414913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.415896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.416978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.417986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.418918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.419938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.420843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.421947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.422961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.423943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.424883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.425978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] role.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] role.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.426961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] role.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] role.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.427941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.428914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.429981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.430964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.431959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.432914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.433879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.434978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.435938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.436969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.437920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.438867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.connection = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.439905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.connection = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.440977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.441867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.442911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.443582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:34:03.443754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.444015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.444259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.444491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.444731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.444965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:34:03.445134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:34:03.473353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.473573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.473789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.474856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.475112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.475321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.482263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.483662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.510261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.510487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.512117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.512386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.564142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.564430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.613431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.613653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.615452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.615687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.774987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.775070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.775147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.775275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.775362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.775466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.798723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.798943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.799972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.800073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.800183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.800429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.811479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.811829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.824456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.824609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.824768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.824894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.824963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.825863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.826062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 13:34:03.842934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.843137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 13:34:03.843232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.843461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 13:34:03.843585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.843655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 13:34:03.843802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 13:34:03.844220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.844759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.845038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.854781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.855073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.855352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.855633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.855840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.856153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.856435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.856712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.862698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.863972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.866015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.866284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.866592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.866877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.867143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.867262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.867434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.867569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.867658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.867773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.868998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.869117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.869411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.869685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.869938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.891623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.893094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.893220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.893387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.894594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.895122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.898164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.898453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.898739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.899803 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.900095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.900380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.905064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.905355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.906656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.906942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.911246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.911546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.911845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.912143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.912421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.912699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.912972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.913141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.913283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.913466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.913744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.914030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.914311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.914590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.914865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.915138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.928732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.929015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.930863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.931143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.932834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.934945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.936045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.936342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.938141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.938434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.940501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.942964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.943824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.946075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.946998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.947411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.947704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.948020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.948301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.948583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.949280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.949580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.949868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.950137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.950414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.950689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.964626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.964918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.965187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.965452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.966938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.967236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.967504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.967769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.972293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.973901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.975033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.975437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.975710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.976602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.978156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.978434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.978557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.978892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.979188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.979467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.979876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.981126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.981411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.981704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.981988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.982364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.991210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.991500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.991816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.992097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.992481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.992782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.993064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.993983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:03.994268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.994548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.994836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.995219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.995484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:03.995760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.008426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.011319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.011447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.014221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.014365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.015775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.017193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.017318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.017580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.017984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.018649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.020451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.020738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.021139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.024363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.025821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.027461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.028726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.028975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.029109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.029401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.029678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.031827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.032228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.032516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.032797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.037587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.037883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.038169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.041017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.041315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.041597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.045057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.045344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.045631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.045971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.046287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.046564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.046849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.047138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.047407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.047665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.047973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.048356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.048457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 13:34:04.048633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.048768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.048904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.048989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.049230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.049502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.049778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.050037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.050332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.050629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.051066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.051532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.051934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.052211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.052486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 13:34:04.083855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2ea22d9c0 pid: 87878 (default app) Oct 15 13:34:04.087361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764215c4-a025-4f65-8001-1bbe74b32880 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:04.087472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2ea22d9c0 pid: 87877 (default app) Oct 15 13:34:04.087654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764215c4-a025-4f65-8001-1bbe74b32880 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:04.087960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764215c4-a025-4f65-8001-1bbe74b32880 None None] PATH_INFO: `/v3` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:04.092225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Sat Oct 15 13:34:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:11.090636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:11.091240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:11.091240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:11.095427 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:11.101442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:11.102085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:11.102085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:11.173380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: INFO dbcounter [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] Registered counter for database keystone Oct 15 13:34:11.193426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG oslo_db.sqlalchemy.engines [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:34:11.201022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writer thread running {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:34:11.382981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG passlib.handlers.bcrypt [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87878) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 15 13:34:11.383266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG passlib.handlers.bcrypt [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87878) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 15 13:34:11.442040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:11.443663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:11.582365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 15 13:34:12.061953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:12.134084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: INFO dbcounter [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] Registered counter for database keystone Oct 15 13:34:12.156758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG oslo_db.sqlalchemy.engines [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:34:12.164820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writer thread running {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:34:12.285489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d73f-05bf-4fc5-bb5b-c6820fc9343a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:12.290318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:12.290948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:12.291222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:12.291499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:12.300586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:12.351869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING keystone.common.rbac_enforcer.enforcer [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 15 13:34:12.352065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637306d5-61d3-4a2c-8d0a-9fbdd4248f8b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:12.362515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Oct 15 13:34:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:34:12.369142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:12.387650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431df4-8840-4d3e-b733-0c77f12b5f3a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:12.393518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:12.394909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:12.395217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:12.395495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] PATH_INFO: `/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:12.397213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccefdcbe08cc44feb4368c7ef30d7a4d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:12.449429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 15 13:34:12.449805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9587d-4a80-4a06-9470-db1f2b87e823 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:12.454541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:34:12 2022] GET /identity/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:14.654024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b913-80bd-45e2-8838-fa27906b9284 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:14.654602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b913-80bd-45e2-8838-fa27906b9284 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:14.654706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b913-80bd-45e2-8838-fa27906b9284 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:14.663016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:14.670773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:14.671264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:14.671356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:14.693444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:14.694969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:14.704341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 15 13:34:14.965679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b913-80bd-45e2-8838-fa27906b9284 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:14.979894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b913-80bd-45e2-8838-fa27906b9284 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:14.984986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:14.985601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:14.985885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:14.986163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:14.994594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:14.996445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba252b-5e82-468c-a3c6-8eda6a836160 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:15.006154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Oct 15 13:34:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:34:15.012395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:15.022213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27446b88-0876-4c2d-bf12-2028d6ad92ab None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:15.027984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:15.028634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:15.028922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:15.029213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] PATH_INFO: `/v3/users/ddbeecebab3748e2bb0c6f73045e40dc` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:15.030609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] RBAC: Authorizing `identity:get_user(user_id=ddbeecebab3748e2bb0c6f73045e40dc)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:15.032518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28c0e-8fbd-416f-b1fb-5975d3f9ffde admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:15.034097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Sat Oct 15 13:34:15 2022] GET /identity/v3/users/ddbeecebab3748e2bb0c6f73045e40dc => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:17.231004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac8d36-03e0-44f9-945a-d6e0e8b49eac None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.231609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac8d36-03e0-44f9-945a-d6e0e8b49eac None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.231609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac8d36-03e0-44f9-945a-d6e0e8b49eac None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.232956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:17.239270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.239876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.239876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.259409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:17.260655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:17.342234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ff8-ea60-4386-adf3-7f7b5e8090c9 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.342519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ff8-ea60-4386-adf3-7f7b5e8090c9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.342796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ff8-ea60-4386-adf3-7f7b5e8090c9 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.344372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:17.349232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:17.349521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.349811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.350089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.393651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG passlib.handlers.bcrypt [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87877) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 15 13:34:17.394098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG passlib.handlers.bcrypt [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87877) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 15 13:34:17.442601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:17.444244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:17.549597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:17.616031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:17.642123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:17.727321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0837-fafc-4af0-a785-91bb29cdbfb0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:17.761809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:17.762468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.762745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.763017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.774415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:17.783177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:17.784379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.785211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:17.790662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:17.813646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:17.899161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:17.900587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036905b-4f6a-4c6b-8df9-237f4299cb8c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:17.903015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:17.919116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701932-ae8b-4fb0-b8a5-7645deae204e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:17.939179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:17.940136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.940420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.940696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.941834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:17.942146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:17.943656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:17.955981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:17.956755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:17.957487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:17.957487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:17.957963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:17.958117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:17.959648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:17.964307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:17.974056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.sql.core [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:34:17.974056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:34:17.974056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [parameters: {'id': '3f3e116697a34ad59b90e976b72ddacf', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 15 13:34:17.974056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:34:17.992820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 15 13:34:17.993750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application yield resource Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.rollback() Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.force_reraise() Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise self.value Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application session.commit() Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 15 13:34:17.994660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._prepare_impl() Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.flush() Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._flush(objects) Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application compat.raise_( Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application flush_context.execute() Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rec.execute(self) Oct 15 13:34:17.995516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 15 13:34:17.996447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:34:17.997238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [parameters: {'id': '3f3e116697a34ad59b90e976b72ddacf', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 15 13:34:17.998090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:17.998828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:17.999666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 8/16] 10.222.0.33 () {60 vars in 1137 bytes} [Sat Oct 15 13:34:17 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:18.002509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:18.076142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da9ed-e389-4d50-8e08-eacaf8a1e11f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:18.113557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3b11b-efc4-48eb-a479-0c1893e2b034 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:18.113813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:18.114411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:18.114695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:18.115174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] PATH_INFO: `/v3/users/ddbeecebab3748e2bb0c6f73045e40dc` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:18.116863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] RBAC: Authorizing `identity:get_user(user_id=ddbeecebab3748e2bb0c6f73045e40dc)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:18.118418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:18.120105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:17 2022] GET /identity/v3/users/ddbeecebab3748e2bb0c6f73045e40dc => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:18.126020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:18.155952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:18.156584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:18.156864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:18.157140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:18.163999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:18.169358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:18.170888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:18.179228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:34:18.189341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:18.190298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:34:18.191174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:34:18.191174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:34:18.191174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:18.191174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:34:18.197268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:18.236833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40f8d-0ee9-4ae5-98dd-201d3d9505ab None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:18.272976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:18.273641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:18.273920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:18.274195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:18.275342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:18.276863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:18.278459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:18.284400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:18.308902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddcdf5-9a38-48e3-9949-9289e7a9a7bf None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:18.348586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:18.349120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:18.350073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:18.350073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:18.350311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:18.350614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:18.352070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7805481-eff5-4109-b0e8-51d609567f08 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:18.370325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:18.396164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9fcc-700c-4e2d-b27c-f8db2fe9457b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:18.398211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:18.436887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:18.437585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:18.437864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:18.438133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] PATH_INFO: `/v3/domains/default/users/ddbeecebab3748e2bb0c6f73045e40dc/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:18.440307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ddbeecebab3748e2bb0c6f73045e40dc, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:18.441837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091f4a9-a417-417f-9a88-75cb12373de5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:18.564474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1361 bytes} [Sat Oct 15 13:34:18 2022] PUT /identity/v3/domains/default/users/ddbeecebab3748e2bb0c6f73045e40dc/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:34:21.214000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657c0d-8fc4-4e20-a389-350178948b05 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.214796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657c0d-8fc4-4e20-a389-350178948b05 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.214796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657c0d-8fc4-4e20-a389-350178948b05 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.216192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:21.220850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861440-8098-4cd8-8774-9bd5b6adca74 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.221525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861440-8098-4cd8-8774-9bd5b6adca74 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.221525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861440-8098-4cd8-8774-9bd5b6adca74 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.226743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 12/23] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:21.229878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec02d4-11e1-4c25-af42-ffb517d7837b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.230167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec02d4-11e1-4c25-af42-ffb517d7837b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.230440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec02d4-11e1-4c25-af42-ffb517d7837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.237799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.238192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.238693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.275821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-16ec02d4-11e1-4c25-af42-ffb517d7837b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:21.275821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-16ec02d4-11e1-4c25-af42-ffb517d7837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:21.284751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:21.287814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:21.390047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:21.414207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 12/24] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:21.455514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d4c-511d-43b9-960e-be41fae551ba None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.455946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d4c-511d-43b9-960e-be41fae551ba None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.456236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca165d4c-511d-43b9-960e-be41fae551ba None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.458153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 13/25] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:21.464631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:21.464862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:21.465114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:21.469300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:21.496802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:21.498012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:21.594394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:21.888641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:21.951143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.011836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:22.021053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3126-16a1-451a-8348-410f1a5bb5fb None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.064453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.065122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.065403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.065683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.089488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:22.091835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6876f98e-965c-47f6-9daa-b2758e4314af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:34:22.114289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:22.115436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:34:22.116309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:34:22.116309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:34:22.116309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:22.118280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342026e-3709-4483-b7d5-7b52201ba5e6 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.118412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 14/28] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:22.119697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d1e-d758-41b2-972f-a8a18035ca12 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.120071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d1e-d758-41b2-972f-a8a18035ca12 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.120416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d1e-d758-41b2-972f-a8a18035ca12 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.123030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 15/29] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:22.123855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557d1e-d758-41b2-972f-a8a18035ca12 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.139910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:22.159324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.160353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.160814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.161299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.162177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:22.164113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bcc64-9e20-4dc4-b772-df68e7618de7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:22.239262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557d1e-d758-41b2-972f-a8a18035ca12 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.277889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.278551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.278905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.279252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.291815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:22.298379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 15/30] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Oct 15 13:34:21 2022] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:22.298842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:22.308362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 16/31] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:22.309212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.309916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.309916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.309916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.313634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:22.356512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:22.361184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:22.504037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 16/32] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:22.505738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.555030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cc70-f1c5-4c32-83a5-b48b72758fdf None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.598519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.599160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.599445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.599799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.600490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:22.600796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:22.602760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:22.622507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 17/33] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:22.628604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.698352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:22.780134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331804-7f2c-4c7c-8093-280b7676b125 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.799536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5a11d-3c26-4da4-8937-cb28b02d9f38 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:22.824245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:22.883131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.883875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:22.884369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.884885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.885213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:22.885378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.891829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:22.892027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:22.892027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:22.892346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:22.893150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:22.893472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:22.897002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:22.927190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 17/34] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:22.928959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:22.949437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 18/35] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:34:22 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:22.950382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:23.131678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846635-5c4d-467a-ad58-736aa2ea9c8c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.152843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b5e3-854a-430f-9c93-626cde48ee92 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.179266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:23.182840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.183840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.184387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.184942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.185828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.187549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.201397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.202591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.202591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.202591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] PATH_INFO: `/v3/users/ddbeecebab3748e2bb0c6f73045e40dc` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.203743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ddbeecebab3748e2bb0c6f73045e40dc)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.205706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e8981-0fb7-4760-a837-0cb49a77f9f7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.207387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 19/36] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:22 2022] GET /identity/v3/users/ddbeecebab3748e2bb0c6f73045e40dc => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:23.211933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d46a-61ea-4fd6-96b5-eda7824f1bb7 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.212083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Oct 15 13:34:22 2022] POST /identity/v3/roles => generated 219 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:23.212179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d46a-61ea-4fd6-96b5-eda7824f1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.212179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d46a-61ea-4fd6-96b5-eda7824f1bb7 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.212179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 20/38] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:23.214457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:23.217666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e57e-dc2c-494d-a3c9-9df71393c299 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.218030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e57e-dc2c-494d-a3c9-9df71393c299 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.218308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e57e-dc2c-494d-a3c9-9df71393c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.239774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a845e57e-dc2c-494d-a3c9-9df71393c299 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:23.241589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a845e57e-dc2c-494d-a3c9-9df71393c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:23.339581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:23.340871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600a59-c94f-4be8-a817-bd4a0b2ae94b None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.341168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600a59-c94f-4be8-a817-bd4a0b2ae94b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.341447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600a59-c94f-4be8-a817-bd4a0b2ae94b None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.342846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 22/40] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:23.349160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.349561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.349941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.375823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:23.378849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:23.387739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:23.473331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 23/41] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:23.492953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468639b-f89d-413f-b32a-93a0ecba6eac None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.530382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.531426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.531940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.532409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.533743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.535610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.537800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 19/42] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:23.544570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:23.592246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:23.612923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:23.648988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c844b-8351-4d28-8feb-8642816b7f04 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.683632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.684298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.684663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.684850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.685592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.domain.id=default, user.id=ddbeecebab3748e2bb0c6f73045e40dc) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:23.685904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.687372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.695710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 24/43] 10.222.0.33 () {56 vars in 1322 bytes} [Sat Oct 15 13:34:23 2022] GET /identity/v3/role_assignments?user.id=ddbeecebab3748e2bb0c6f73045e40dc&scope.domain.id=default&role.id=19608e06d1c94b169326bd0a33985478 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:23.738563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:23.743232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab71bd-b884-4845-ba6e-98f68452eef1 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.752816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:23.783992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.784680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.784960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.785368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.785959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.787383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.805491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 20/44] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Oct 15 13:34:23 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:23.889855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098d61f-efaa-41fd-a086-29744782ffb6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:23.901742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:23.935910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:23.936599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:23.936891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:23.937156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:23.938415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:23.940033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f39e1-c123-470e-95c8-b8c001406f1f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:23.942174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 25/45] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:23.948058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:24.058880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f6b-b868-4bd6-a577-b7c87fa1076b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:24.093768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:24.094390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:24.094673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:24.094946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:24.095617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:24.097334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c50301-e333-4455-983a-8378aea093a0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:24.127314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 21/46] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:34:23 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:26.296419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130838b4-e168-48b7-bf6a-1d92856cc785 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:26.296966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130838b4-e168-48b7-bf6a-1d92856cc785 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:26.296966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130838b4-e168-48b7-bf6a-1d92856cc785 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:26.298315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 26/47] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:26.304008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:26.304429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:26.304510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:26.323432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:26.324698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:26.327755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:26.396450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 22/48] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:26.661184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130838b4-e168-48b7-bf6a-1d92856cc785 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:26.773868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130838b4-e168-48b7-bf6a-1d92856cc785 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:26.810018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:26.810660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:26.810940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:26.811207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:26.812450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:26.814115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533fa73-7e6c-403c-a6a6-3cdcda262b28 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:26.815516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 27/49] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:26.821861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:26.928642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d636b-a9d7-4cdc-bb4c-6c084171b3ca None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:26.965220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:26.965854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:26.966137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:26.966412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:26.967070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:26.968580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028016ca-e6be-4745-8d3e-8303adc41489 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:26.980314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:26.997078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 23/50] 10.222.0.33 () {60 vars in 1140 bytes} [Sat Oct 15 13:34:26 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:29.116408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2a5f-0ab2-4a90-a5b5-c7488c90b505 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:29.116923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2a5f-0ab2-4a90-a5b5-c7488c90b505 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:29.116923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2a5f-0ab2-4a90-a5b5-c7488c90b505 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:29.118227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 28/51] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:29.123572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:29.124031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:29.124130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:29.143435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:29.145008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:29.216506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 24/52] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:29.484274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2a5f-0ab2-4a90-a5b5-c7488c90b505 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:29.537442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:29.597312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2a5f-0ab2-4a90-a5b5-c7488c90b505 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:29.635636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:29.636330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:29.636614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:29.636887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:29.638115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:29.639618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2d1f9-046a-425a-bb65-f5d2d9fde80b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:29.641303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 29/53] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:29.647383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:29.759172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776949d-9a87-4678-af09-5ee5f624a112 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:29.784478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:29.798476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:29.799098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:29.799380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:29.799647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:29.800481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:29.802116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f25f0-9417-4c8c-a105-5481cd667649 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:29.833691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 25/54] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:29 2022] POST /identity/v3/users => generated 275 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:33.213614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7676-3af9-46c3-96c4-87f1d0167fdc None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.213614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7676-3af9-46c3-96c4-87f1d0167fdc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.213614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7676-3af9-46c3-96c4-87f1d0167fdc None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.213614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 30/55] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:33.219821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ff4a-68b9-47b0-8054-a1b9a7502645 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.220675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ff4a-68b9-47b0-8054-a1b9a7502645 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.221117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ff4a-68b9-47b0-8054-a1b9a7502645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.248845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-eb16ff4a-68b9-47b0-8054-a1b9a7502645 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:33.250309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-eb16ff4a-68b9-47b0-8054-a1b9a7502645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:33.252557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0d0a-83fc-4ad1-a9cc-3791b9713429 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.253054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0d0a-83fc-4ad1-a9cc-3791b9713429 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.253530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0d0a-83fc-4ad1-a9cc-3791b9713429 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.255036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 31/56] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:33.262027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.262538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.262952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.287487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:33.290758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:33.367457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 26/57] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:33.369814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe112-8aac-4da6-9933-1da0df60b218 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.370344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe112-8aac-4da6-9933-1da0df60b218 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.370855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe112-8aac-4da6-9933-1da0df60b218 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.372618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 27/58] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:33.378523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.379083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.379543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:33.392764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 32/59] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:33.412844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:33.415336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:33.532684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 28/60] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:33.660850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:33.766861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:33.840082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc60a-5f6c-4821-bdcc-5978ead70e87 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:33.857795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:33.909808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:33.978413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430644-d3df-4ffe-ad03-17946f335b75 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:33.994300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:33.995064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:33.995367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:33.995645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.007532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-752e02d5-4afc-4808-aeb7-aa1f342f2b39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:34.012769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:34.013626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:34.014366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:34.014950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.014950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.014950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.015142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 33/61] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:34.015203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.015271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0686f-37bc-4548-b1c4-c9b9b1bebfad None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.015340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0686f-37bc-4548-b1c4-c9b9b1bebfad None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.015575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0686f-37bc-4548-b1c4-c9b9b1bebfad None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.016832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 34/62] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:34.017520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0686f-37bc-4548-b1c4-c9b9b1bebfad None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.032710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:34.037844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:34.038719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:34.039486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 29/63] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:34:34.044659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.131697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0686f-37bc-4548-b1c4-c9b9b1bebfad None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.133432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.156430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.160424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401981d-48dd-4824-b349-bf3e028ba7ec None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.170382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.171036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.171312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.171587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.182526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6ab96f9f-bc92-4bf1-9773-c69a949c5227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:34.187892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:34.188750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:34.189936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 35/64] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:34.191299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.191299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.191451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.201373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.202013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.202300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.202576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.203260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:34.203567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.205384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.212554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:34.213741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:34.215189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 30/65] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.216069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.288178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 36/66] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:34.289193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.333091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b1399-b174-4d53-83c1-cd10c6ce3a06 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.380861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.381592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.382071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.382347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.383094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:34.383508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.385684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.397851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 31/67] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.398810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.403324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.419097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7394-5b42-4fbc-9826-834e24c4cb9c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.427315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.457494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.458131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.458414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.459110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.459825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:34.460408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.461826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.470895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 37/68] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.475738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.517246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a4f2-026d-4869-a241-be387a0c73b6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.554088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.554736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.555045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.555317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.571735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.573264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a8d2-fc04-4313-bcdc-21c59fdb40a6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.574971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 32/69] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.576343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f7f7-c4f3-47e2-bb80-1fac0262c339 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.576627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f7f7-c4f3-47e2-bb80-1fac0262c339 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.576905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8f7f7-c4f3-47e2-bb80-1fac0262c339 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.578110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 33/70] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:34.583087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ec2fb-3657-4231-a255-a99dba765a10 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.583806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8f7f7-c4f3-47e2-bb80-1fac0262c339 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.618772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.619396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.619677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.620024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] PATH_INFO: `/v3/users/ddbeecebab3748e2bb0c6f73045e40dc` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.621198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] RBAC: Authorizing `identity:get_user(user_id=ddbeecebab3748e2bb0c6f73045e40dc)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.622663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.624320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 38/71] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/users/ddbeecebab3748e2bb0c6f73045e40dc => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.625099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.649163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.669017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.689590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8f7f7-c4f3-47e2-bb80-1fac0262c339 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.727894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa3c4-7eac-4701-a211-e57f5d232132 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.728204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.728862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.729148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.729427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.730572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.732087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.733693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 34/72] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.734471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.766774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.767686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.767998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.768279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.778575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-18682de0-ce89-455b-ae76-fd81b776dae6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:34.783479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:34.784563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:34.785348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 39/73] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:34.785987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.786206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.786472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.804765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:34.805962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:34.842146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ea421-fcff-45d1-8073-71b8335861d8 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:34.876244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 40/74] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:34.877113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.880691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:34.881541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:34.881828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:34.882112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:34.883277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:34.884796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:34.891357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 35/75] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:34.891357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:34.896633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.914069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:34.993210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a9a41-c012-4218-a2a7-14e28cda298f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.002833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d296-fc54-44ac-a8de-4496155d16bc None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.027617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.028342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.028628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.028963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.030116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.031590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.033286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 41/76] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:35.034095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.044052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.045348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.045632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.045913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.047051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.048572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.051834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 36/77] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:34 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:35.051834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.128290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.150123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.150925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb356-a300-42e9-a394-89404ac2b16d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.166400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db80b-ae69-41db-905b-583296c2b6ef None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.185461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.186072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.186363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.186632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.187304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:35.187603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.189044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.197542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 42/78] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:35.198234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.204849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.205541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.205825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.206266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/2b56edddce3246039f31f9e14efa657e/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.208434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, user_id=2b56edddce3246039f31f9e14efa657e, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.209908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.226551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 37/79] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:35 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/2b56edddce3246039f31f9e14efa657e/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:35.227364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.320656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf3984-d2e6-49d5-9e01-eb173c6f6a97 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.361569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32dc87-8fff-45a7-b6f1-46147e190480 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.366090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.366790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.367071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.367344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/ddbeecebab3748e2bb0c6f73045e40dc/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.370297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, user_id=ddbeecebab3748e2bb0c6f73045e40dc, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.371814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.390052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 43/80] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:35 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/ddbeecebab3748e2bb0c6f73045e40dc/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:35.391025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.394508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.413844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.414707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.414996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.415317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/2b56edddce3246039f31f9e14efa657e/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.417998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, user_id=2b56edddce3246039f31f9e14efa657e, role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.419569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.436801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 38/81] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:35 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/2b56edddce3246039f31f9e14efa657e/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:35.437733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.464049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.558485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33221b-4815-4710-bda1-cf65f708b366 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.626946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.627628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.628433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.628712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.630131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.631647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.633392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 44/82] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:35.635680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c537-da44-400a-bf28-a95887d28081 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.639221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.684471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.685193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.685475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.685746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.687359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.688821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.691143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 39/83] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:35 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:35.700970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.738074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.793257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:35.827960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b298b-7c30-4361-9546-b5ba898f3f12 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.840022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c216-dcc4-40b5-ae1d-1748da7b0f99 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:35.893821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.894497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.894783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.895068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] PATH_INFO: `/v3/projects/52ba71486c4a49ddbc65e70383f4768f` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.898998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] RBAC: Authorizing `identity:get_project(project_id=52ba71486c4a49ddbc65e70383f4768f)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.900528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.907316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 40/84] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:35 2022] GET /identity/v3/projects/52ba71486c4a49ddbc65e70383f4768f => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:35.908281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:35.917178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:35.917815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:35.918095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:35.918369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:35.919049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:35.920577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649fa9b-c8c8-430a-bd17-ea266acccb43 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:35.970321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 45/85] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:35 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:36.080897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d56a9d-c708-4b51-aba5-2fcbd43caf2c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:36.127941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:36.128744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:36.129034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:36.129320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] PATH_INFO: `/v3/projects/52ba71486c4a49ddbc65e70383f4768f/users/2b56edddce3246039f31f9e14efa657e/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:36.135724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] RBAC: Authorizing `identity:create_grant(project_id=52ba71486c4a49ddbc65e70383f4768f, user_id=2b56edddce3246039f31f9e14efa657e, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:36.137316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d613ea-4fea-4558-a2f9-dafc4ebd1bdf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:36.160552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:36.165482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 41/86] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:35 2022] PUT /identity/v3/projects/52ba71486c4a49ddbc65e70383f4768f/users/2b56edddce3246039f31f9e14efa657e/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:37.831633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9468-57be-40f6-ab6b-914e4a61d0b3 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:37.832185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9468-57be-40f6-ab6b-914e4a61d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:37.832257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9468-57be-40f6-ab6b-914e4a61d0b3 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:37.833833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 46/87] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:37.839421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7761-6176-452c-a2e6-7d7e3622c433 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:37.839919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7761-6176-452c-a2e6-7d7e3622c433 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:37.839995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7761-6176-452c-a2e6-7d7e3622c433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:37.859187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c54e7761-6176-452c-a2e6-7d7e3622c433 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:37.860441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c54e7761-6176-452c-a2e6-7d7e3622c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:37.951114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 42/88] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:38.096838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9fae-e177-4796-b9d4-dbc306be2b54 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.097169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9fae-e177-4796-b9d4-dbc306be2b54 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.097374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9fae-e177-4796-b9d4-dbc306be2b54 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.098758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 47/89] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:38.104600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91866cf-4dab-4666-82c4-45b73def7ef0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.104885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91866cf-4dab-4666-82c4-45b73def7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.105159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91866cf-4dab-4666-82c4-45b73def7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.134148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a91866cf-4dab-4666-82c4-45b73def7ef0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:38.135372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a91866cf-4dab-4666-82c4-45b73def7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:38.220274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 43/90] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:38.344630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9fae-e177-4796-b9d4-dbc306be2b54 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:38.388207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfeb62-2f3d-415c-b278-c8fa64adade8 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.388831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfeb62-2f3d-415c-b278-c8fa64adade8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.389295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfeb62-2f3d-415c-b278-c8fa64adade8 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.390852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 44/91] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:38.396803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.397394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.397881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.425170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:38.427699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:38.524333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9fae-e177-4796-b9d4-dbc306be2b54 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:38.554655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:38.573279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 45/92] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:38.577812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:38.589874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:38.590843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.591372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.591999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.604170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:38.609577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:38.610470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:38.611242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:38.614116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 48/93] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:38.619774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:38.777415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a64c3-2ec8-466f-836b-55635523d6d4 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:38.808542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:38.861775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:38.863944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:38.864914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:38.865633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:38.867097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:38.868078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:38.871285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:38.898341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 46/94] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:38.911155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.039314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.050894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec149-76ac-4088-8b4a-dc05b5940b0d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.109484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.110882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.111410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.111973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.115970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6687ba-cef7-413c-bc15-45315b371463 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.126480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:39.132929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:39.133809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:39.134577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:39.137415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 49/95] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:39.138431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.155321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.155977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.156269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.156547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] PATH_INFO: `/v3/users/ddbeecebab3748e2bb0c6f73045e40dc` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.157701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] RBAC: Authorizing `identity:get_user(user_id=ddbeecebab3748e2bb0c6f73045e40dc)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:39.159388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae68e0d-3156-4548-afe0-fafb0f20fe25 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:39.161251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 47/96] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:38 2022] GET /identity/v3/users/ddbeecebab3748e2bb0c6f73045e40dc => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:39.162471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e0a4-40da-4e51-9f41-0697ffeafe4a None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.162818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e0a4-40da-4e51-9f41-0697ffeafe4a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.163139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e0a4-40da-4e51-9f41-0697ffeafe4a None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.164575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 48/97] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:39.169749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e0a4-40da-4e51-9f41-0697ffeafe4a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.200938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.271278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3763b-0421-4e20-a1ab-5a5eee2eec5b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.313318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.314403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.314935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.315450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.330992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-4d0c5463-0454-4689-b0f0-4d6533feea2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:39.336590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:39.337726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:39.338597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:39.343193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 50/98] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:39.344504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.344960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.345387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.364602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e0a4-40da-4e51-9f41-0697ffeafe4a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.366756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:39.368091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:39.405623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.439204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.439854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.440205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.440612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.441608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] RBAC: Adding query filter params (name=member) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:39.441918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:39.443360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:39.453318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 49/99] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:39.454239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.481975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 51/100] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:39.482963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.526158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.588463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcdf6-8b9f-44a8-bd3a-70cb18ecacac None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.626949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.628072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.628829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.629305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.645031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bf8b-ae67-4666-b56e-e77e226aae65 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.700127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.720527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.721180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.721543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.721941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.722879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:39.723192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:39.728840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:39.741105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:39.742265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 52/101] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:39.743153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.744346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:39.873509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 50/102] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:39.875373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.905833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:39.909887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5be4-2f1a-4d6f-b4cf-819f9aa90bf6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:39.948684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:39.949359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:39.949640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:39.949914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:39.951196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:39.952712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:39.954904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 53/103] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:39.955635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:39.983992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.007463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658078b-3596-48d7-80ae-d2941d97492d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.047264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.047828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.048107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.048386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.049827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:40.051548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:40.053361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 51/104] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:40.054182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.093140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180a26-33a5-4426-9f5b-631d65266b51 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.139815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.140344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.140941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.140941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.160914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-89f80d8e-e92f-45a8-abed-bc6237648557 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:40.167769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:40.169147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:40.170473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 54/105] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:40.171652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed86911-f432-4f9c-99e3-57a7e996fd88 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.171652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed86911-f432-4f9c-99e3-57a7e996fd88 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.171652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed86911-f432-4f9c-99e3-57a7e996fd88 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.173161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 55/106] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:40.180618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed86911-f432-4f9c-99e3-57a7e996fd88 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.187407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98281ca5-f75e-4cce-b4e3-5120360110d2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.218548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.237255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.237927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.238212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.238492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.239738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:40.241310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:40.243029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 52/107] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:40.245310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.277818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.318772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed86911-f432-4f9c-99e3-57a7e996fd88 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.357233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.357848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.358127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.358404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.395472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b53d-99ab-4ca9-93f8-e809f8c78694 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.437440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:40.438992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:40.443289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.443975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.444253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.444528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.490861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.535284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:40.537984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8945e-df5d-4609-8be6-933749622fde None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:40.570124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.603721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 56/108] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:40.604978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.697855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 53/109] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:40.700138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e64d-7ee1-4f71-8bdc-eaad2c6e0aa0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.700625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e64d-7ee1-4f71-8bdc-eaad2c6e0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.701108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e64d-7ee1-4f71-8bdc-eaad2c6e0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.728507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b7b4e64d-7ee1-4f71-8bdc-eaad2c6e0aa0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:40.730402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b7b4e64d-7ee1-4f71-8bdc-eaad2c6e0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:40.763668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1ce0-72b2-4296-b446-9486e3a04cb4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.794573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.808714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:40.809693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.810155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.810563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.811696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:40.812188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:40.814590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 54/110] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d8c5-bfac-4cb5-8407-24eec595ecc3 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d8c5-bfac-4cb5-8407-24eec595ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d8c5-bfac-4cb5-8407-24eec595ecc3 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 55/111] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:40.832195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9d8c5-bfac-4cb5-8407-24eec595ecc3 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.842504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 57/112] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:40.843844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:40.908949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:40.972187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9d8c5-bfac-4cb5-8407-24eec595ecc3 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:40.975962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d582-100c-425f-ba43-560bd3812e7b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.013560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.014474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.014936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.015437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.016543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=3816cd3efc054b9b92213f3e63f90330, user.id=ddbeecebab3748e2bb0c6f73045e40dc) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:41.017051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.017492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.018436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.018689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.018915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.019364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c085f-0440-4519-94ac-28158259ecb7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.020424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.022044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.030110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 58/113] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.030110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.041587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 56/114] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:40 2022] GET /identity/v3/role_assignments?user.id=ddbeecebab3748e2bb0c6f73045e40dc&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.041587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.041587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.041587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.068191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:41.069545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:41.149016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:41.164539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 57/115] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:41.165901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.215345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107666ef-2181-49c4-ac55-13b517ebda7f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.245910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:41.272363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.273339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.273788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.274429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.275884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.277709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.280136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 59/116] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.281255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.388690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a967f4-75eb-4b37-b030-5819dd27b634 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.421133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc116-a719-4f66-9cba-f793b8f0312a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.448110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.448110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.448110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.448110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] PATH_INFO: `/v3/users/2b56edddce3246039f31f9e14efa657e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.448867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] RBAC: Authorizing `identity:get_user(user_id=2b56edddce3246039f31f9e14efa657e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.448867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.448867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 58/117] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/users/2b56edddce3246039f31f9e14efa657e => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.448867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.456645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:41.469689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.470320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.470603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.470881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.471735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] RBAC: Adding query filter params (role.id=f76404c6460e4bef90535587cf1814d1, scope.project.id=3816cd3efc054b9b92213f3e63f90330, user.id=2b56edddce3246039f31f9e14efa657e) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:41.472085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.473710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.480171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 60/118] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/role_assignments?user.id=2b56edddce3246039f31f9e14efa657e&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=f76404c6460e4bef90535587cf1814d1 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.481034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.657674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006104-0737-4ec9-9d79-86efba28b524 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.681118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:41.693173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c817952-dc5a-41e6-b0a1-ed8845d48b15 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.735118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.735994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.736405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.737025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.738353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] RBAC: Adding query filter params (role.id=0a15993814224f1fbf73bd70a958b9c5, scope.project.id=3816cd3efc054b9b92213f3e63f90330, user.id=2b56edddce3246039f31f9e14efa657e) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:41.738866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:41.741176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:41.747998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.748678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.748965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.749241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.753088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 59/119] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/role_assignments?user.id=2b56edddce3246039f31f9e14efa657e&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=0a15993814224f1fbf73bd70a958b9c5 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:41.754157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.773140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:41.784329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:41.785357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:41.786241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:41.786857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 61/120] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:41.789129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:41.862997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:41.904909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4d1a8-eb3b-4a32-aeda-71d9d6bd6d26 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.950961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccadfb-e862-4de4-b0aa-18f69380ba39 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:41.961209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.961885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.962135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:41.963683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:41.998388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:41.999188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:41.999494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.003644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.003644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.003644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.004216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 62/121] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:42.006216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.039834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.081983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.084855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.112094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79411e6e-0c88-49e7-9fdd-07cc82733bce None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.130229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.152118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.153157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.153540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.153906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.154865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:42.155349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.156964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.166746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 63/122] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:42.167873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.199810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 60/123] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:42.200707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.293094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.297617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-5968-4164-b701-6b018ec1ad1b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.321745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac152c5-34b1-4820-b802-94f536e5e7d6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.334787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.335423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.335695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.336018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.336673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.338143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.360031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.360687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.360973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.361254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] PATH_INFO: `/v3/users/9f2fc89318c149318dc391689c73e08a` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.372013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 64/124] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:34:42 2022] POST /identity/v3/projects => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:42.373417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.382380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=9f2fc89318c149318dc391689c73e08a)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.383997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.385826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 61/125] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:42 2022] GET /identity/v3/users/9f2fc89318c149318dc391689c73e08a => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:42.392195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.430580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.532283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75813635-73f4-42e2-b37e-59b22c3d3fb9 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.552453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930d87d-93a4-46b8-9ce8-98ba7279d90a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.584149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.591092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.591760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.592081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.592365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.593685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.595218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.596830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 62/126] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:42 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:42.603344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.604630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.605302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.605590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.605868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] PATH_INFO: `/v3/projects/52ba71486c4a49ddbc65e70383f4768f` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.607065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] RBAC: Authorizing `identity:get_project(project_id=52ba71486c4a49ddbc65e70383f4768f)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.608887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.611654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 65/127] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:42 2022] GET /identity/v3/projects/52ba71486c4a49ddbc65e70383f4768f => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:42.618595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:42.739175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:42.746155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249908-1e32-4d37-afb3-dbffe9521d5f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.746504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c6568-4f8a-41c3-9c2c-7702caf94902 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:42.787955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.788796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.789091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.789365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/9f2fc89318c149318dc391689c73e08a/roles/c30e535169cd422098a3d1edc918f384` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.791778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, user_id=9f2fc89318c149318dc391689c73e08a, role_id=c30e535169cd422098a3d1edc918f384)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.793524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaba69-aa8f-4c9f-a10e-c4201f8237e5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.798834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:42.799572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:42.799893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:42.800171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:42.800994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] RBAC: Adding query filter params (role.id=f76404c6460e4bef90535587cf1814d1, scope.project.id=52ba71486c4a49ddbc65e70383f4768f, user.id=2b56edddce3246039f31f9e14efa657e) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:42.801375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:42.803124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c67c-b9c8-4418-8b82-31841e2ccd66 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:42.819823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 66/128] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:42 2022] GET /identity/v3/role_assignments?user.id=2b56edddce3246039f31f9e14efa657e&scope.project.id=52ba71486c4a49ddbc65e70383f4768f&role.id=f76404c6460e4bef90535587cf1814d1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:42.820061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 63/129] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:42 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/users/9f2fc89318c149318dc391689c73e08a/roles/c30e535169cd422098a3d1edc918f384 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:34:44.617084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d05ff-afd1-44cb-b934-a4ca36b393fa None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:44.617705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d05ff-afd1-44cb-b934-a4ca36b393fa None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:44.617705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d05ff-afd1-44cb-b934-a4ca36b393fa None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:44.618991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 67/130] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:44.624993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb666-533d-4e38-ad89-bcf097295009 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:44.625520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb666-533d-4e38-ad89-bcf097295009 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:44.625638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb666-533d-4e38-ad89-bcf097295009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:44.646649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-743fb666-533d-4e38-ad89-bcf097295009 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:44.647982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-743fb666-533d-4e38-ad89-bcf097295009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:44.730628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:44.751302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 64/131] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:45.027261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d05ff-afd1-44cb-b934-a4ca36b393fa None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:45.182481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea852-c455-4a58-9a35-7d0c1f27e63b None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:45.182983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea852-c455-4a58-9a35-7d0c1f27e63b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:45.183368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea852-c455-4a58-9a35-7d0c1f27e63b None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:45.185065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 65/132] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:45.191914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:45.192353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:45.192743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:45.208173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d05ff-afd1-44cb-b934-a4ca36b393fa None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:45.221773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:45.223759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:45.265140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:45.265921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:45.266218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:45.266542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:45.268122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:45.270697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:45.273082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 68/133] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:45.279254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:45.319929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:45.329499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 66/134] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:45.413439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312714-bc9b-4221-8ca1-1ce0e6d659f9 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:45.449269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:45.449898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:45.450184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:45.450453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:45.451128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:45.452609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:45.475710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 69/135] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:45 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:45.621084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:45.754811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe9780-4a3f-4a94-8c06-780978a9e6e8 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:45.778177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:45.795870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:45.796553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:45.796840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:45.797104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:45.810764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:45.815893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:45.816910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:45.817809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 67/136] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:45.827291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:45.949575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:45.973475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174dea-c72a-4d56-bc10-774deda60567 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:46.024306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:46.024951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:46.025237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:46.025514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:46.026201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:46.026507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:46.028453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:46.040046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 70/137] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:46.046450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:46.170737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996767f2-3623-41f1-9833-62a888d0194d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:46.213058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:46.214090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:46.214582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:46.215052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] PATH_INFO: `/v3/users/9f2fc89318c149318dc391689c73e08a` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:46.216587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] RBAC: Authorizing `identity:get_user(user_id=9f2fc89318c149318dc391689c73e08a)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:46.218342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:46.220698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 68/138] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:46 2022] GET /identity/v3/users/9f2fc89318c149318dc391689c73e08a => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:46.226845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:46.357288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7c485-0e93-453e-acf8-8942cabe68a4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:46.400939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:46.402010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:46.402576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:46.403054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:46.428295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:46.501969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:46.504014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:46.623779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 71/139] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:46.629985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:46.682982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:46.742961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b42d9-f2b8-4489-8be6-ab910b3b152e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:46.779208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:46.779995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:46.780162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:46.780436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:46.781601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:46.783096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f4862-904c-43c5-a758-125a10608b01 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:46.785193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 69/140] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:46 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:46.791474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:46.842823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:46.901960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4698ef0-cfa4-47c5-995f-6622f4b82c5e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:46.940947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:46.941588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:46.941872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:46.942152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:46.942905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] RBAC: Adding query filter params (role.id=c30e535169cd422098a3d1edc918f384, scope.project.id=3816cd3efc054b9b92213f3e63f90330, user.id=9f2fc89318c149318dc391689c73e08a) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:46.943218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:46.944730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f402a-5149-4905-8695-91a74a64a09d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:46.951173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 72/141] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:46 2022] GET /identity/v3/role_assignments?user.id=9f2fc89318c149318dc391689c73e08a&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=c30e535169cd422098a3d1edc918f384 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:47.854545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c3d0-3ec9-4642-b4c3-bd042b3fec0a None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:47.855078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c3d0-3ec9-4642-b4c3-bd042b3fec0a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:47.855078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c3d0-3ec9-4642-b4c3-bd042b3fec0a None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:47.856699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 70/142] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:47.862004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385daf2-aa6f-4542-91a1-219aa3da8b63 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:47.862455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385daf2-aa6f-4542-91a1-219aa3da8b63 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:47.862556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385daf2-aa6f-4542-91a1-219aa3da8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:47.881587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5385daf2-aa6f-4542-91a1-219aa3da8b63 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:47.882757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5385daf2-aa6f-4542-91a1-219aa3da8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:47.957762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 73/143] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:48.029592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc990e-4e06-469c-a761-2573b0216677 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.029784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc990e-4e06-469c-a761-2573b0216677 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.030060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc990e-4e06-469c-a761-2573b0216677 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.031599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 71/144] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:48.037037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a6ca-65ff-485c-8741-85cd8f1c12f8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.037324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a6ca-65ff-485c-8741-85cd8f1c12f8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.037594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a6ca-65ff-485c-8741-85cd8f1c12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.056673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ddd4a6ca-65ff-485c-8741-85cd8f1c12f8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:48.057867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ddd4a6ca-65ff-485c-8741-85cd8f1c12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:48.102306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.138233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 74/145] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:48.202742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f3da-1d8f-4f75-8ae3-c1460adf3bf1 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.202983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f3da-1d8f-4f75-8ae3-c1460adf3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.203290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f3da-1d8f-4f75-8ae3-c1460adf3bf1 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.205186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 72/146] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:48.210846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.211111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.211402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.218230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325f3da-1d8f-4f75-8ae3-c1460adf3bf1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.231348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:48.232576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:48.307860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 75/147] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:48.334059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325f3da-1d8f-4f75-8ae3-c1460adf3bf1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.351431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.370397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.371060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.371321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.371598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.382571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:48.387687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:48.388563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:48.389565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 73/148] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:34:48.397046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.408363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.509441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe93f6-cbd3-4a8e-8311-4a7a14e3b00b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.511900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.518230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71c40-2c96-4d15-8fe7-69ae4a0c5ef4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.552023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.552648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.552974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.553241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.553960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:48.554268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:48.555635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:48.556597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.557243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.557517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.557779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.564818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 76/149] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:48.569145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:48.570248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:48.574012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:48.574880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:48.575669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 74/150] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:48.577241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.613317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.677012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ef1e-d256-4d98-8be6-af9d79ef4b43 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.680525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502ade-f648-42d2-833e-86cd16fbd0d3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.713254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.713937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.714219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.714495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] PATH_INFO: `/v3/users/3d61e11af0674be38b54d82fcb6442ba` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.717698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.718358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.718637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.718938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.720267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:48.722309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:48.724035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 75/151] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:48.724849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.732735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] RBAC: Authorizing `identity:get_user(user_id=3d61e11af0674be38b54d82fcb6442ba)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:48.734340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:48.736162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 77/152] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/users/3d61e11af0674be38b54d82fcb6442ba => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:48.737669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.765481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.839295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c87c6-83df-4e6b-945e-ac514868f7e0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.842114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:48.853274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd872-b84a-4f65-877e-ffd63bdd6072 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:48.876747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.877871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.877871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.878066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.878685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:48.878985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:48.880477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:48.888900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 76/153] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:48.889699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:48.890738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:48.891403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:48.891680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:48.891977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:48.892642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:48.895440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:48.918970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 78/154] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:48 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:48.919839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:49.008961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d131-4ec3-40a7-809e-1547c5e2959b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:49.015343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:49.042483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09a2e-7519-4d7f-b8f0-a2929ac44fe8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:49.048861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:49.049615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:49.049899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:49.050773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:49.052084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:49.054350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:49.056410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 77/155] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:49.062363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:49.083160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:49.083856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:49.084126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:49.084398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] PATH_INFO: `/v3/users/3d61e11af0674be38b54d82fcb6442ba` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:49.085597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] RBAC: Authorizing `identity:get_user(user_id=3d61e11af0674be38b54d82fcb6442ba)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:49.087075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:49.088783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 79/156] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:48 2022] GET /identity/v3/users/3d61e11af0674be38b54d82fcb6442ba => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:49.094676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:49.108158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:49.184884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163fff-5e88-4496-9f5d-2b4f3184f00d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:49.225157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd080-19a6-4b34-ad56-9bdaa637d19b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:49.229887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:49.230800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:49.231068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:49.231405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/3d61e11af0674be38b54d82fcb6442ba/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:49.233571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, user_id=3d61e11af0674be38b54d82fcb6442ba, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:49.235203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:49.253502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 78/157] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:49 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/3d61e11af0674be38b54d82fcb6442ba/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:49.271479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:49.272449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:49.272950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:49.273408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:49.277075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:49.278216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b786c-60d8-4536-88cc-e51a0861b0d6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:49.280169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 80/158] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:49 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:49.287246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:49.413962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:49.423035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ee3d2-912c-468e-9e30-cbb8cfccc990 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:49.466292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:49.466969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:49.467248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:49.467515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/3d61e11af0674be38b54d82fcb6442ba/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:49.469771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, user_id=3d61e11af0674be38b54d82fcb6442ba, role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:49.471330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fee7f-cd14-4f0c-b1a3-410365190451 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:49.493014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 79/159] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:49 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/3d61e11af0674be38b54d82fcb6442ba/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:51.287997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc558a-106a-42e8-8f0e-e1fa48626f1d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.288864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc558a-106a-42e8-8f0e-e1fa48626f1d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.289277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc558a-106a-42e8-8f0e-e1fa48626f1d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.291044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 81/160] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:51.296934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dedd7-aa64-419e-9119-a7b85af91b62 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.297792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dedd7-aa64-419e-9119-a7b85af91b62 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.298255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dedd7-aa64-419e-9119-a7b85af91b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.317773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-dc1dedd7-aa64-419e-9119-a7b85af91b62 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:51.319347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-dc1dedd7-aa64-419e-9119-a7b85af91b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:51.374982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbc9-ce79-4e9c-bd89-2b2e25446e5b None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.375600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbc9-ce79-4e9c-bd89-2b2e25446e5b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.376089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbc9-ce79-4e9c-bd89-2b2e25446e5b None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.377793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 82/161] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:51.383154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab54c6-268e-4729-8633-2f89072b0759 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.383466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab54c6-268e-4729-8633-2f89072b0759 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.383718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab54c6-268e-4729-8633-2f89072b0759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.394284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 80/162] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:51.405817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-eeab54c6-268e-4729-8633-2f89072b0759 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:51.407034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eeab54c6-268e-4729-8633-2f89072b0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:51.424362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:51.488279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 83/163] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:51.559922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e2633-9eba-4b30-955b-f8cc557343ac None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.560166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e2633-9eba-4b30-955b-f8cc557343ac None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.560595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e2633-9eba-4b30-955b-f8cc557343ac None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.562302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 81/164] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:51.569904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.570234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.570474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.592352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:51.593647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:51.666755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 84/165] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:51.701171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d1a8-4010-4e0f-a1c7-5d42a6d880ce None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.701454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d1a8-4010-4e0f-a1c7-5d42a6d880ce None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.701729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d1a8-4010-4e0f-a1c7-5d42a6d880ce None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.702382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:51.703087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 82/166] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:51.719047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.719534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.719995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.739544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:51.741159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:51.795514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:51.817613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 83/167] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:51.818226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:51.833762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394d01-8557-4cb4-8b06-53480ea4d967 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:51.834714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:51.876529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:51.877434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.877710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.878044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.890199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:51.896150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:51.897104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:51.897894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 85/168] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:51.903073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:51.939069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bf32f-c241-498b-8bff-c2225ab75140 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:51.975368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:51.976040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:51.976308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:51.976580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:51.977746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:51.979214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:51.980826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 84/169] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:51.986064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.020348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d64f3-5a21-4826-85d7-70e814ccff68 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.055320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.056047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.056347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.056618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.057299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:52.057591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.058994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.060435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.073209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 86/170] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:52.073209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.076877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.098729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f442a-1a59-445f-9315-9239e3da921e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.136454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.137090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.137365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.137633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.148167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:52.153461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:52.154453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:52.155327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 85/171] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:52.156017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.186035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55097ca5-f589-4926-8df4-b2ca141d0cf9 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.222196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.222961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.223299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.223571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.224280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.225767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.253359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 87/172] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:52 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:52.264030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.275530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a751-2dc3-4067-a5ef-04a2f491468b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.318630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.320137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.320412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.320682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] PATH_INFO: `/v3/users/b0f47265fb80402a977dc257df91b6a1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.327481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.336986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.340145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f47265fb80402a977dc257df91b6a1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.342822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.345374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 86/173] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/users/b0f47265fb80402a977dc257df91b6a1 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:52.347009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.399868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673226-3238-4bff-b2e4-572e3e50bdc3 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.442730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.443658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.444000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.444718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.460404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:52.468113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:52.469075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:34:52.469891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:52.470484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf230-30a2-4b94-ab00-998010b22b42 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.470556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 88/174] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:52.470556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.513745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.514643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.514925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.515203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.515947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:52.516251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.518119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.528462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 87/175] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:52.529345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.614465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.617974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558aa07-c0cb-4ff7-b598-445450dbaf04 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.635317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.663472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.664705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.665081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.665362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.667203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f4d-defb-4702-b301-b4d4c09342bf None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.667319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.669440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.671378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 89/176] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:52.675656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.716468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.717368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.717646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.717918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.718606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:52.719176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.721798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.732569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 88/177] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:52.733596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.803799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837305ea-1ce4-46a4-815d-7d45af0650eb None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.845991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.846656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.846931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.847380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] PATH_INFO: `/v3/users/3d61e11af0674be38b54d82fcb6442ba` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.849061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d61e11af0674be38b54d82fcb6442ba)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.850663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.852671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 90/178] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/users/3d61e11af0674be38b54d82fcb6442ba => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:52.854230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da482f8-f91c-4b88-bcac-c846e9d4e5a5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:52.858046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.889278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.910457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:52.911144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:52.911417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:52.911688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/b0f47265fb80402a977dc257df91b6a1/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:52.913714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, user_id=b0f47265fb80402a977dc257df91b6a1, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:52.915200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:52.929495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:52.933539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 89/179] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:52 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/b0f47265fb80402a977dc257df91b6a1/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:34:52.935553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:52.996888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6e71-c4d3-414a-ac32-32268ffc0de1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:53.040662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:53.041386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:53.042363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:53.042693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] PATH_INFO: `/v3/users/3d61e11af0674be38b54d82fcb6442ba` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:53.044417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d61e11af0674be38b54d82fcb6442ba)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:53.046229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:53.048476 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 91/180] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/users/3d61e11af0674be38b54d82fcb6442ba => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:53.055084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:53.089948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e682a-a019-43e1-8c72-131a69eadc38 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:53.187406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3af1e-604d-4d06-b2f4-e51e1173d7a1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:53.188345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:53.189176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:53.189657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:53.190075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:53.212331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:53.231778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:53.233018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:53.233548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:53.233958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:53.262984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:53.298749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:53.301697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:53.355687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:53.358140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:53.480623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 90/181] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:53.492983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:53.528424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 92/182] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:53.535537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:53.564317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:53.643088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:53.685993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e507eb-888b-4cd5-841d-c03164a7c61a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:53.757692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719ff58-6f6f-4a8a-8388-687f193dc38c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:53.772459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:53.773493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:53.773936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:53.774396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:53.775765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:53.778095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:53.787994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 91/183] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:53 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:53.796045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:53.873009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:53.874045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:53.874503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:53.874950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:53.877149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:53.883744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:53.896211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 93/184] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:53 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:53.906157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:54.104608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30075-bf85-4839-b4d9-1bb8adff53c5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:54.151814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:54.180169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bafd9-0f3b-4025-a2f9-3b6e570356a5 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:54.224979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:54.225620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:54.225972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:54.226244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:54.227001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956, user.id=3d61e11af0674be38b54d82fcb6442ba) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:54.227311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:54.228860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b1116-796b-44f9-9931-b32bff7aae8c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:54.246121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:54.247145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:54.247614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:54.248125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:54.250245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] RBAC: Adding query filter params (role.id=0a15993814224f1fbf73bd70a958b9c5, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956, user.id=3d61e11af0674be38b54d82fcb6442ba) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:54.250794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:54.253952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1ebd-8f19-4515-9222-fa5f95fa8d94 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:54.263392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 92/185] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:53 2022] GET /identity/v3/role_assignments?user.id=3d61e11af0674be38b54d82fcb6442ba&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:54.270102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 94/186] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:53 2022] GET /identity/v3/role_assignments?user.id=3d61e11af0674be38b54d82fcb6442ba&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=0a15993814224f1fbf73bd70a958b9c5 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:54.762199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cc2e-6b48-46fe-8a57-79403d38e07c None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:54.762745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cc2e-6b48-46fe-8a57-79403d38e07c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:54.763150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cc2e-6b48-46fe-8a57-79403d38e07c None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:54.766113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 93/187] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:54.772681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e6af-eb1c-40df-972a-f307a2c33d73 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:54.773997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e6af-eb1c-40df-972a-f307a2c33d73 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:54.774738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e6af-eb1c-40df-972a-f307a2c33d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:54.810513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a569e6af-eb1c-40df-972a-f307a2c33d73 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:54.812930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a569e6af-eb1c-40df-972a-f307a2c33d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:54.941395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 95/188] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:55.029985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd8b1-9750-47f1-871d-924b7ae558a5 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.030235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd8b1-9750-47f1-871d-924b7ae558a5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.030416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd8b1-9750-47f1-871d-924b7ae558a5 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.032029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 94/189] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:55.040752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.041240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.041694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.073996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:55.076627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:55.202368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:55.211034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd8b1-9750-47f1-871d-924b7ae558a5 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.233888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:55.332708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd8b1-9750-47f1-871d-924b7ae558a5 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:55.372748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:55.373389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.373665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.373929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.385711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:55.390634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:55.392382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:55.394312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 95/191] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:34:55.402838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.416738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:55.468537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.559513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc511d-2b2f-42aa-bef1-2b2f0f461d2d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:55.588913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:55.623317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:55.624392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.624890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.625367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.626593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:55.627201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:55.629903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:55.630509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c50cd-b6b9-4906-94a2-06aad96a7b07 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:55.643335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:55.652393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.694757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:55.696200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.696679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.697137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.699051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:55.701747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:55.705382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:55.716958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.748222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:55.791424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7e99c-41e3-42e4-a84c-3fd24e715320 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:55.837019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:55.838009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.838414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.838808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] PATH_INFO: `/v3/users/5cbe23760f1348d4b21b0f55f2325eb1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.857572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] RBAC: Authorizing `identity:get_user(user_id=5cbe23760f1348d4b21b0f55f2325eb1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:55.859472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:55.862099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 98/194] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:55 2022] GET /identity/v3/users/5cbe23760f1348d4b21b0f55f2325eb1 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:55.868738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:55.891039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26ba-f3a4-4407-bee6-3cb1e9fa1f95 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:55.942519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:55.943489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:55.944342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:55.944796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:55.945847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:55.948388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:55.976155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:55.995832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 97/195] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:55 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:34:56.027869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4aa6c-9934-42d5-9831-5430bb0b028c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:56.064526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:56.075559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:56.076502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:56.076903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:56.077308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:56.079194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:56.081159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06f84-b061-48d0-a4f0-0b787587dfbb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:56.083579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 99/196] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:55 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:34:56.090260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:56.254089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c6aa-82c2-403f-a24b-6f0be7214bce None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:56.263836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410922-cdcd-4fae-8ef5-6b1622be4393 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:56.264468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410922-cdcd-4fae-8ef5-6b1622be4393 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:56.264748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410922-cdcd-4fae-8ef5-6b1622be4393 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:56.266403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 100/197] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:56.272461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:56.272879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:56.273019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:56.295383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:56.296666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:56.321426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:56.322133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:56.322498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:56.322779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/5cbe23760f1348d4b21b0f55f2325eb1/roles/c30e535169cd422098a3d1edc918f384` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:56.325795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, user_id=5cbe23760f1348d4b21b0f55f2325eb1, role_id=c30e535169cd422098a3d1edc918f384)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:56.327900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:56.352470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 98/198] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:34:56 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/users/5cbe23760f1348d4b21b0f55f2325eb1/roles/c30e535169cd422098a3d1edc918f384 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:34:56.427379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 101/199] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:56.913549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:57.025735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:57.081542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c2b12-afda-46a2-9525-de9da4a5146c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:57.121921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:57.122632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:57.123020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:57.123381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] PATH_INFO: `/v3/roles/member` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:57.138065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:57.143684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:57.145373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:34:57.146915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 99/200] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:57.154769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:57.336332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d989e-2378-47cd-94b7-19657b3eaf99 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:57.383426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:57.398745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:57.399773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:57.400321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:57.400815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:57.402017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:57.402560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:57.405235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:57.426324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 102/201] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:57.432995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:57.556872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c415a-4fe0-48b8-8655-142707153fba None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:57.578253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:57.594406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:57.594973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:57.595247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:57.595515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] PATH_INFO: `/v3/users/b0f47265fb80402a977dc257df91b6a1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:57.596896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f47265fb80402a977dc257df91b6a1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:57.598451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:57.600436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 100/202] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:34:57 2022] GET /identity/v3/users/b0f47265fb80402a977dc257df91b6a1 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:57.609264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:57.740846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83026-2e29-49c7-beb3-f4db1aa022df None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:57.777185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:57.777835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:57.778115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:57.778388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:57.840287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:57.861571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:57.864223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:58.023079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 103/203] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:34:58.029442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:58.146686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef30d-142d-43a8-81dd-a7e8c1d420d2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:58.184372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:58.185025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.185303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.185577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.186727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:58.188246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd21b5-1841-456f-91af-1fa69720be40 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:58.190845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 101/204] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:34:58 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:58.197352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:58.292107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:58.305227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23ef9-ee9f-49b7-9f67-98252c879122 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:58.342596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:58.343229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.343506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.343777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.344541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] RBAC: Adding query filter params (role.id=f76404c6460e4bef90535587cf1814d1, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956, user.id=b0f47265fb80402a977dc257df91b6a1) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:34:58.344849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:58.346377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520ee4c-854a-4e03-9b84-943ee01454d1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:58.353391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 104/205] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:34:58 2022] GET /identity/v3/role_assignments?user.id=b0f47265fb80402a977dc257df91b6a1&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=f76404c6460e4bef90535587cf1814d1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:58.887757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532fcf7-b804-4cdd-94e3-8719cbcf8038 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.888260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532fcf7-b804-4cdd-94e3-8719cbcf8038 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.888386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532fcf7-b804-4cdd-94e3-8719cbcf8038 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.889879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 102/206] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:34:58.895539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef839-bf06-46c5-b94b-d7cfa249fd2e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.895856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef839-bf06-46c5-b94b-d7cfa249fd2e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.896133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef839-bf06-46c5-b94b-d7cfa249fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.916540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0f5ef839-bf06-46c5-b94b-d7cfa249fd2e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:58.917853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0f5ef839-bf06-46c5-b94b-d7cfa249fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:58.952174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101e74-3376-412c-b070-2fb867f32a94 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.952554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101e74-3376-412c-b070-2fb867f32a94 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.952724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101e74-3376-412c-b070-2fb867f32a94 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.954486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 103/207] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:58.960984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:58.961255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:58.961535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:58.980949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:58.982086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:59.003697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 105/208] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:34:59.046581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:59.057190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4640f-67fa-4763-80be-914bed727983 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.057473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4640f-67fa-4763-80be-914bed727983 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.057749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4640f-67fa-4763-80be-914bed727983 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.059160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 106/209] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:34:59.067155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36502-fee8-494c-af71-060f46376799 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.067448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36502-fee8-494c-af71-060f46376799 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.067696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36502-fee8-494c-af71-060f46376799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.071701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 104/210] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:59.101401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-78f36502-fee8-494c-af71-060f46376799 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:34:59.103463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-78f36502-fee8-494c-af71-060f46376799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:34:59.237747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 107/211] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:34:59.351196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.441050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36502-fee8-494c-af71-060f46376799 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.468454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:59.481758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f599527-e23e-4c07-a589-8295ffe14399 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:59.529049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:59.529799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.530208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.530940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.532660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:59.534545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:59.536724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 105/212] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:34:59.542988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.630418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:59.636037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36502-fee8-494c-af71-060f46376799 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:59.674865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:59.675535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.675890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.676109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.687926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:59.693282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:59.694419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 108/213] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:59.696362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.709066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddfc3-3c30-4f49-9455-48e34862fdd4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:59.765676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:59.766400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.766739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.767134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.768269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:34:59.770091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:34:59.795118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:34:59.802702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 106/214] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:34:59 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:34:59.804070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.843038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a08d-ae08-4a21-96ac-e46cfadbd50a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:59.893814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:34:59.895305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:34:59.895763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:34:59.896206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:34:59.914095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:34:59.922501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:34:59.923482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:34:59.924458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:34:59.925115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 109/215] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:34:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:34:59.931592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:34:59.963467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c999-5661-43d7-8fff-e5d270997a21 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:34:59.977402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.010502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.011144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.011423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.011729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.012459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:00.012764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.014257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.028720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 107/216] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:00.034960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:00.097386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34c782-c976-4bb9-b630-aea7ea780873 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.138509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.145345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.146006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.146866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.147137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.147924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:00.148235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.149715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.161762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 110/217] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:34:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:00.167770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:00.210258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8041-56da-443d-9c47-b0d86c4472c6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.251737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.252652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.252934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.253212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] PATH_INFO: `/v3/users/40a7597801514126a6897a08a6bd0658` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.270582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] RBAC: Authorizing `identity:get_user(user_id=40a7597801514126a6897a08a6bd0658)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.272116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.274059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 108/218] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/users/40a7597801514126a6897a08a6bd0658 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:00.279952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:00.316451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.322224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2305-2b5c-4260-9657-49157a3933bf None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.361665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.362238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.362521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.362796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] PATH_INFO: `/v3/users/5cbe23760f1348d4b21b0f55f2325eb1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.364072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=5cbe23760f1348d4b21b0f55f2325eb1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.365681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.367325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 111/219] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/users/5cbe23760f1348d4b21b0f55f2325eb1 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:00.373009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:00.404496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264b91-b013-481c-8b2a-036dc34ff489 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.444084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.447391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.448480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.448905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.449460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.450516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] RBAC: Adding query filter params (role.id=f76404c6460e4bef90535587cf1814d1, user.id=40a7597801514126a6897a08a6bd0658, scope.system=all) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:00.451103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.453261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.462495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 109/220] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/role_assignments?user.id=40a7597801514126a6897a08a6bd0658&scope.system=all&role.id=f76404c6460e4bef90535587cf1814d1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:00.494615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b997c-2c16-4379-9683-132c817d4bd7 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.536335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.536984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.537267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.537543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.623411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.624913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.695408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.750705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 112/221] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:00.756825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:00.865528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:00.873143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814590c-33ce-4d12-8123-6800fef10baf None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:00.913027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:00.913599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:00.913879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:00.914157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:00.915345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:00.917012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59c93c-8fde-4da1-8d91-ddfbc96588cd None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:00.919039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 110/222] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:00.925438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:01.114754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec212ae-2f21-4f1d-bf60-8f4853aded20 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:01.181275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:01.182360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:01.182849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:01.183322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:01.184783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] RBAC: Adding query filter params (role.id=c30e535169cd422098a3d1edc918f384, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956, user.id=5cbe23760f1348d4b21b0f55f2325eb1) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:01.185334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:01.188172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc9f2-f511-48bc-b8e8-3d7e0901c6db None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:01.200169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 113/223] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:00 2022] GET /identity/v3/role_assignments?user.id=5cbe23760f1348d4b21b0f55f2325eb1&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=c30e535169cd422098a3d1edc918f384 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:02.425936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e9700-08bd-4850-812e-f62743b2a05a None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:02.426868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e9700-08bd-4850-812e-f62743b2a05a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:02.426868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e9700-08bd-4850-812e-f62743b2a05a None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:02.428144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 111/224] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:02.434083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:02.434875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:02.434875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:02.464458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:02.466494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:02.508143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:02.599870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 114/225] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:03.067762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e669-21ec-4f41-b897-550fc4f2b161 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.068272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e669-21ec-4f41-b897-550fc4f2b161 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.068686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e669-21ec-4f41-b897-550fc4f2b161 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.071454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 112/226] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:03.078772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.079228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91375ff-5acd-45ac-a96a-e1740fd2d5e5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.079502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91375ff-5acd-45ac-a96a-e1740fd2d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.079819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91375ff-5acd-45ac-a96a-e1740fd2d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.111672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d91375ff-5acd-45ac-a96a-e1740fd2d5e5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:03.113637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d91375ff-5acd-45ac-a96a-e1740fd2d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:03.232888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 113/227] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:03.250409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267e25f-b520-4e5f-9a9e-e6cf89e32aa8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:03.315010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:03.316143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.316627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.317105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.337920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:03.342974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2c44-e0d8-4bf6-8d67-8579882f2366 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.343369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2c44-e0d8-4bf6-8d67-8579882f2366 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.343523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2c44-e0d8-4bf6-8d67-8579882f2366 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.345239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 114/228] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:03.348053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:03.349720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:03.357669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 115/229] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:03.359153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.359153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.359153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.363760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.374480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:03.375707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:03.398050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:03.458777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 115/230] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:03.520129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89f1d6-b225-4c46-be22-f21bb9cc0682 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:03.565239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:03.565891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.566169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.566440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.567161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:03.567465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:03.568980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:03.584009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 116/231] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:03.586805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.615857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:03.700523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.723922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada2805-f7d0-4582-bbfc-ee755d7707fe None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:03.763486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:03.764177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.764458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.764730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] PATH_INFO: `/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.781399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] RBAC: Authorizing `identity:get_user(user_id=f17f1c5e19fd45e1ae25f8e82a511aae)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:03.783250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:03.786516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 116/232] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:03.791866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.845375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:03.871031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461890-172e-4d6f-9609-c552a905d24f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:03.901031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:03.914197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:03.915152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.915523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.915966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.917485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:03.919156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:03.920841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 117/233] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:03.921644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:03.925309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e0f1-1153-4fd7-9436-d13d97baac49 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:03.970888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:03.971907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:03.972395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:03.972845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:03.974222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] RBAC: Adding query filter params (role.id=c30e535169cd422098a3d1edc918f384, user.id=f17f1c5e19fd45e1ae25f8e82a511aae, scope.system=all) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:03.974773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:03.977434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:03.986270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 117/234] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/role_assignments?user.id=f17f1c5e19fd45e1ae25f8e82a511aae&scope.system=all&role.id=c30e535169cd422098a3d1edc918f384 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:03.987727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:04.054857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3472-8c31-48ed-9a72-4ae587d97a1d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:04.102396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:04.103066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:04.103347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:04.103621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:04.117359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:04.121796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38748d6-f7d7-413d-b253-411ad8a8c609 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:04.122953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:04.123840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:04.124674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:04.129517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 118/235] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:04.130549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:04.142017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:04.169317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:04.170263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:04.170716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:04.171234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] PATH_INFO: `/v3/groups` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:04.172189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:04.173991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:04.196777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 118/236] 10.222.0.33 () {60 vars in 1134 bytes} [Sat Oct 15 13:35:03 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:04.265390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9466b-f5d8-480b-94e7-8cfa73801d77 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:04.310794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:04.311441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:04.311721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:04.312083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:04.312836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:04.313142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:04.314853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:04.335830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 119/237] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:04.339776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:04.346992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:04.522963 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4063de-8897-49d5-94ef-f8594d2a34ca None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:04.585789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:04.586902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:04.587408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:04.587934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] PATH_INFO: `/v3/users/40a7597801514126a6897a08a6bd0658` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:04.589956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] RBAC: Authorizing `identity:get_user(user_id=40a7597801514126a6897a08a6bd0658)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:04.592684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bebf29-fd04-425f-810f-65d3fd32b78a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:04.596168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 119/238] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:04 2022] GET /identity/v3/users/40a7597801514126a6897a08a6bd0658 => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:04.605451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:04.725710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:04.772569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea2e1f-0d11-4802-9e00-4b22199f3eb7 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:04.829720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:04.830648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:04.830936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:04.831074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] PATH_INFO: `/v3/system/users/40a7597801514126a6897a08a6bd0658/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:04.832647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=40a7597801514126a6897a08a6bd0658, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:04.834092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46cfb6-01c9-4e5a-a935-c7a0054ae26d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:04.848013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 120/239] 10.222.0.33 () {58 vars in 1334 bytes} [Sat Oct 15 13:35:04 2022] PUT /identity/v3/system/users/40a7597801514126a6897a08a6bd0658/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:06.291664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c42ca-aa14-423e-9834-f4ac22157d72 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:06.292273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c42ca-aa14-423e-9834-f4ac22157d72 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:06.292555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c42ca-aa14-423e-9834-f4ac22157d72 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:06.294099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 120/240] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:06.304753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28967c9-4f46-45ce-bc21-ae25cec347ad None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:06.305410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28967c9-4f46-45ce-bc21-ae25cec347ad None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:06.305696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28967c9-4f46-45ce-bc21-ae25cec347ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:06.332954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d28967c9-4f46-45ce-bc21-ae25cec347ad None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:06.334320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d28967c9-4f46-45ce-bc21-ae25cec347ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:06.443864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 121/241] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:06.543827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aab66-e863-4ea4-82ff-22f4177b6d00 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:06.544259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aab66-e863-4ea4-82ff-22f4177b6d00 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:06.544739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aab66-e863-4ea4-82ff-22f4177b6d00 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:06.547383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 121/242] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:06.553558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:06.553829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:06.554136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:06.576839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:06.578072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:06.649914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:06.664680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 122/243] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:06.935085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aab66-e863-4ea4-82ff-22f4177b6d00 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:06.938143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.061155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:07.088357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440083d-189d-4953-a1d9-127da06d65b8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.110096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aab66-e863-4ea4-82ff-22f4177b6d00 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.139942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.140589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.140857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.141133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.150284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.150956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.151235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.151506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.152943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:07.153152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:07.154466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0154363-f3e6-4c0f-8a09-f32799bdde40 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:07.156210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 122/244] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:07.157471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428a36-c01a-4e4c-859d-3489f4f58ab2 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.157795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428a36-c01a-4e4c-859d-3489f4f58ab2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.158073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428a36-c01a-4e4c-859d-3489f4f58ab2 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:07.158839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:07.160717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:07.163257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:07.164197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 123/245] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:07.164282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 123/246] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:07.164365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428a36-c01a-4e4c-859d-3489f4f58ab2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.167290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.231636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:07.289195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428a36-c01a-4e4c-859d-3489f4f58ab2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.293723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0b0b-a9d2-4bfe-ad06-05ef2819f2c2 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.330680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.331383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.331757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.332169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] PATH_INFO: `/v3/groups` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.333021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:07.334126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.334755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.334851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:07.335035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.335303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.336021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:07.336315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:07.337690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95e16-c6fe-4b15-84f9-e562f5079165 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:07.348106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 124/247] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:07.349425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585404-fa65-4977-b861-18b25276c8df None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.349708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585404-fa65-4977-b861-18b25276c8df None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.349985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585404-fa65-4977-b861-18b25276c8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.352763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:07.371886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 124/248] 10.222.0.33 () {60 vars in 1134 bytes} [Sat Oct 15 13:35:07 2022] POST /identity/v3/groups => generated 226 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:07.371886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.372311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b9585404-fa65-4977-b861-18b25276c8df None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:07.372311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b9585404-fa65-4977-b861-18b25276c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:07.461856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 125/249] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:07.497519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18399-172f-41df-a2de-3126b94c83c6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.537787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.538447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.538719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.538984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] PATH_INFO: `/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.540334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f17f1c5e19fd45e1ae25f8e82a511aae)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:07.541877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:07.547832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 125/250] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:07 2022] GET /identity/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:07.549822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9585404-fa65-4977-b861-18b25276c8df None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.605577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:07.677597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9585404-fa65-4977-b861-18b25276c8df None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.726460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.727474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.727960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.728395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] PATH_INFO: `/v3/system/users/f17f1c5e19fd45e1ae25f8e82a511aae/roles/c30e535169cd422098a3d1edc918f384` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:07.730056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f17f1c5e19fd45e1ae25f8e82a511aae, role_id=c30e535169cd422098a3d1edc918f384)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:07.731701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:07.743901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 126/251] 10.222.0.33 () {58 vars in 1334 bytes} [Sat Oct 15 13:35:07 2022] PUT /identity/v3/system/users/f17f1c5e19fd45e1ae25f8e82a511aae/roles/c30e535169cd422098a3d1edc918f384 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:07.782012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:07.885552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:07.950200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071ec7-511c-48a7-a76f-374a1e3569d3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:07.994599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:07.995267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:07.995572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:07.995884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:08.009685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:08.017849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:08.018885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:08.019682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:08.022122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:08.027994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:08.178455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3310841-cc08-484c-8e6d-49f5c88507be None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:08.192614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:08.233211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:08.233866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:08.234146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:08.234415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:08.235102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:08.235403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:08.237379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:08.250735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 127/253] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:08.257689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:08.406555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-fd68-4476-85f3-37116f650d16 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:08.441772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:08.450136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:08.450821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:08.451243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:08.451626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] PATH_INFO: `/v3/users/40a7597801514126a6897a08a6bd0658` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:08.453033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] RBAC: Authorizing `identity:get_user(user_id=40a7597801514126a6897a08a6bd0658)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:08.454955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca8594-7688-467b-899f-2cfca95007c2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:08.459241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 127/254] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:08 2022] GET /identity/v3/users/40a7597801514126a6897a08a6bd0658 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:08.463700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:08.602583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e676-0784-46ea-ac19-41d300c900f6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:08.654572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:08.655172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:08.655450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:08.655718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:08.656498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] RBAC: Adding query filter params (role.id=f76404c6460e4bef90535587cf1814d1, user.id=40a7597801514126a6897a08a6bd0658, scope.system=all) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:08.656842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:08.658450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa279d4c-1509-49c9-9577-8385733f2c50 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:08.672148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 128/255] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Oct 15 13:35:08 2022] GET /identity/v3/role_assignments?user.id=40a7597801514126a6897a08a6bd0658&scope.system=all&role.id=f76404c6460e4bef90535587cf1814d1 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:10.504676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978918f9-67b3-45ad-a378-942a81ccd023 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:10.505378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978918f9-67b3-45ad-a378-942a81ccd023 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:10.505378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978918f9-67b3-45ad-a378-942a81ccd023 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:10.506868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 128/256] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:10.513047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c210-ea97-49b1-afaf-8e9024178027 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:10.513660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c210-ea97-49b1-afaf-8e9024178027 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:10.513660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c210-ea97-49b1-afaf-8e9024178027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:10.549204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7a18c210-ea97-49b1-afaf-8e9024178027 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:10.550604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7a18c210-ea97-49b1-afaf-8e9024178027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:10.598007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:10.643263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 129/257] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 15 13:35:10.704210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74268-9d54-41b6-8bca-d089cc339065 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:10.704923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74268-9d54-41b6-8bca-d089cc339065 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:10.704923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74268-9d54-41b6-8bca-d089cc339065 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:10.706555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 129/258] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:10.712748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:10.713074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:10.713286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:10.742097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:10.743308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:10.832391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 130/259] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:11.165437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74268-9d54-41b6-8bca-d089cc339065 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.176955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.190727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74268-9d54-41b6-8bca-d089cc339065 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.199567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.200670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.201164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.201670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.229656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:11.235104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:11.236870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:11.237659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:11.243259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 130/260] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:11.248185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.272218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c0037-517b-42ae-89be-7e19ea4b7d65 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.281893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.282691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.283087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.283087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.284443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] RBAC: Adding query filter params (name=member) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:11.284765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:11.288920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:11.288920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:35:11.288920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:35:11.288920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:11.308752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 131/261] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:11.315678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.331064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478a45-2814-4a0e-9f59-8ad0e423333d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.347236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.348313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.348806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.350258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.367054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:11.368557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:11.368557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:35:11.368557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:35:11.370194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:11.372222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 132/262] 10.222.0.33 () {56 vars in 1201 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:11.381386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.404313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736444-bed3-46df-938f-ecf2bc72b511 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.410834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.411861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.412515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.413000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.414530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:11.417694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:11.420239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 133/263] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:11.427936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.429066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24c7e-0dbf-400a-b63d-55bbdfc9aef7 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.443434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866334d-a024-4f19-b432-52bdcadb6aef admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.444302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:11.449097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.451341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.451341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.451341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/groups/cac350e30d0f454eb2eb4632487075f4/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.454236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, group_id=cac350e30d0f454eb2eb4632487075f4, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:11.457073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:11.457073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:35:11.457073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:35:11.460239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:11.494670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.495399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.495762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.496075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.498585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 134/264] 10.222.0.33 () {58 vars in 1463 bytes} [Sat Oct 15 13:35:11 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/groups/cac350e30d0f454eb2eb4632487075f4/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:35:11.518946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-01d57991-7d31-425e-aa50-424193ddfb00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:11.524442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:11.525419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:11.526204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 131/265] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:11.534089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.581756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ca58-eec4-45a9-b54c-af5281d9d7fb None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.582714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ca58-eec4-45a9-b54c-af5281d9d7fb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.582995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ca58-eec4-45a9-b54c-af5281d9d7fb None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.584770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 132/266] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:11.593862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.594151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.594424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.627439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:11.628684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:11.734512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 133/267] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 15 13:35:11.764195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ee963-58fb-429e-a942-e4b02dcd8265 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:11.810037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:11.810696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:11.810976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:11.811238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:11.811990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:11.812300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:11.813872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:11.828475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 135/268] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:11.834656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:11.991219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83757-1103-4c24-9aa5-f2ddcb573979 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.004902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:12.031883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.032637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.033539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.033818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] PATH_INFO: `/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.035060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] RBAC: Authorizing `identity:get_user(user_id=f17f1c5e19fd45e1ae25f8e82a511aae)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.036610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac683b-aa38-469c-9b50-f916e1645368 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.038284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 134/269] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:35:11 2022] GET /identity/v3/users/f17f1c5e19fd45e1ae25f8e82a511aae => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.044556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.059411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ca-942e-4114-b259-7277af4f965f None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.059725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ca-942e-4114-b259-7277af4f965f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.060019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ca-942e-4114-b259-7277af4f965f None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.061541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 135/270] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:12.069761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:12.072170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e643e36-d02c-475b-94a2-fde0c92a72ba None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.072456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e643e36-d02c-475b-94a2-fde0c92a72ba None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.072731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e643e36-d02c-475b-94a2-fde0c92a72ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.101143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1e643e36-d02c-475b-94a2-fde0c92a72ba None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:12.102408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1e643e36-d02c-475b-94a2-fde0c92a72ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:12.123032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 136/271] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 15 13:35:12.124210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f3b-1065-4531-a8e1-c484e99de771 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.124491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f3b-1065-4531-a8e1-c484e99de771 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.124765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f3b-1065-4531-a8e1-c484e99de771 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.127681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 137/272] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:12.134667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.134950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.135217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.178060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:12.179291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:12.201007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 138/273] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 15 13:35:12.253545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233a482-3fe4-4280-9f98-701a6fe3b3ef None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.300837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.301470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.301746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.302014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.302746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] RBAC: Adding query filter params (role.id=c30e535169cd422098a3d1edc918f384, user.id=f17f1c5e19fd45e1ae25f8e82a511aae, scope.system=all) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:12.303054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.304536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.324849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 136/274] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/role_assignments?user.id=f17f1c5e19fd45e1ae25f8e82a511aae&scope.system=all&role.id=c30e535169cd422098a3d1edc918f384 => generated 510 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:12.509484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.522977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12bc42-99c8-42bd-9c6b-23fa8ec02965 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.527866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.528541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.528817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.529089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.534485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.547545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356115c-96d9-4062-9c86-0febd3e01cd4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.567513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.568205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.568483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.568753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.576847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:12.582893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:12.583828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:12.584630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:12.597741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:12.602718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:12.604843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 137/275] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:12.606855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.608567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 139/276] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:12.610887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.632918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35f95-4e07-44cb-a0ed-597909f21a01 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.645300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc88d-ea99-46c2-a6dd-658c39092606 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.649771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.650409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.650692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.650970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.651671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:12.652004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.653901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:12.653901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:35:12.653901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:35:12.654804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.659824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.660486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.660759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.661023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.661702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:12.661999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.663664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.683575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 140/277] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.685868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.687644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 138/278] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.696678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.719531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c690-a748-4931-8ca7-bf4f20e81089 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.723891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6664d5-2ac1-413f-8abc-5d31723facf1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.730179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.730833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.731108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.731375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.733133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.733799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.734070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.734339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.735900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.737962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.739918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 139/279] 10.222.0.33 () {56 vars in 1201 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.741864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.742923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:12.742923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:35:12.742923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:35:12.744191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.746258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 141/280] 10.222.0.33 () {56 vars in 1201 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.753215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.754436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.783438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90aee6-f459-4bea-895f-be91c1920044 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.783887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7560a87-d488-42a5-b8a9-cd0d6bc9d165 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.788322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.788985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.789274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.789673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.793499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.795226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.797316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.797584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.797903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.799949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.799949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.799949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.803666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.805829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.807722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 142/282] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.811853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.818294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd199d-a2c4-4b81-8e07-cede1680f0b3 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.827123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62777-25be-4343-9ef1-4c19317ef64d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.829110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.829803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.830080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.830340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.834966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.835704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.836069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.836340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330/groups/cac350e30d0f454eb2eb4632487075f4/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.840886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3816cd3efc054b9b92213f3e63f90330, group_id=cac350e30d0f454eb2eb4632487075f4, role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.841802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:35:12.841802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:35:12.841802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:35:12.846274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.848865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:12.855212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:12.856303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:12.857131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 141/283] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:12.858855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.874850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088f22-34a1-4839-8157-e4a9fbd87d4c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.876335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 143/284] 10.222.0.33 () {58 vars in 1463 bytes} [Sat Oct 15 13:35:12 2022] PUT /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330/groups/cac350e30d0f454eb2eb4632487075f4/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:12.877438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:12.938468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:12.958762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a65c-4da6-48ab-8141-cae8fa6f30e4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:12.963816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:12.964522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:12.964800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:12.965068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:12.965834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:12.966135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:12.967901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:12.978630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 144/285] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:12.989432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:13.001435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:13.002153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.002492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.002767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/groups/cac350e30d0f454eb2eb4632487075f4/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.006878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, group_id=cac350e30d0f454eb2eb4632487075f4, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:13.009322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e371-9c0b-48c7-a55d-91daf8ec29e4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:13.012647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:13.022650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:13.023318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.023694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.024002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.025262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:13.027305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:13.029578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 145/286] 10.222.0.33 () {56 vars in 1201 bytes} [Sat Oct 15 13:35:12 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:13.041721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:13.053570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 142/287] 10.222.0.33 () {58 vars in 1463 bytes} [Sat Oct 15 13:35:12 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/groups/cac350e30d0f454eb2eb4632487075f4/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:13.070310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25101d-5ddd-44f4-98ed-c339d0cbfbe4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:13.208279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:13.209838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.210605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.211508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.214134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:13.218891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016435-f696-479e-a532-cc89a3a2f58e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:13.222682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 146/288] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:35:13 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:13.232188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:13.251413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3f7f-5ae3-454c-826f-9857ad2624f1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:13.260353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:13.262217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.262995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.263853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/groups/cac350e30d0f454eb2eb4632487075f4/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.268777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b6fa4a33ff4049adee2750c4b88956, group_id=cac350e30d0f454eb2eb4632487075f4, role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:13.275064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73326cdf-22e1-4cf5-8b15-6692ba6858a4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:13.303989 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 143/289] 10.222.0.33 () {58 vars in 1463 bytes} [Sat Oct 15 13:35:13 2022] PUT /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956/groups/cac350e30d0f454eb2eb4632487075f4/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:13.388010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f0d7e-c99c-4eff-ae28-f9cbe167a539 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.388898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f0d7e-c99c-4eff-ae28-f9cbe167a539 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.389742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f0d7e-c99c-4eff-ae28-f9cbe167a539 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.392960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 147/290] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:13.400559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:13.401446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:13.402178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:13.442788 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:13.446176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:13.571593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 144/291] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 15 13:35:13.980896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f0d7e-c99c-4eff-ae28-f9cbe167a539 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:14.006753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f0d7e-c99c-4eff-ae28-f9cbe167a539 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:14.012698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:14.013756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:14.014415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:14.014900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:14.027890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:14.032924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:14.040844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:14.041813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:14.042620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 148/292] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:14.049184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:14.059525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b8e4b-6906-4d94-ab60-518c62e6c80d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:14.068126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:14.068767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:14.069044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:14.069315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:14.070001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:14.070304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:14.072070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:14.082276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 145/293] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:14.088032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:14.103256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57ba-a78f-4fe6-8c39-23ecc7ce6074 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:14.111088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:14.111862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:14.112142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:14.112452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] PATH_INFO: `/v3/groups/e33cde9308274a13bd9ceb6aee722c38` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:14.121721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] RBAC: Authorizing `identity:get_group(group_id=e33cde9308274a13bd9ceb6aee722c38)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:14.123813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:14.125570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 149/294] 10.222.0.33 () {56 vars in 1201 bytes} [Sat Oct 15 13:35:14 2022] GET /identity/v3/groups/e33cde9308274a13bd9ceb6aee722c38 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:14.131658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:14.142393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f19ba5-66ab-4feb-af65-4d2a70d0a5de admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:14.148767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:14.149427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:14.149736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:14.150019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] PATH_INFO: `/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:14.151224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccefdcbe08cc44feb4368c7ef30d7a4d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:14.153230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd771d7-a5d1-4e41-82e4-43b9d6016132 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:14.155098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 146/295] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Oct 15 13:35:14 2022] GET /identity/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:14.161445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:14.173333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67247-bd07-4bdc-83c4-640cfccdf395 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:14.179050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:14.179840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:14.180126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:14.180399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] PATH_INFO: `/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d/groups/e33cde9308274a13bd9ceb6aee722c38/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:14.182636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccefdcbe08cc44feb4368c7ef30d7a4d, group_id=e33cde9308274a13bd9ceb6aee722c38, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:14.185684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b0239-ede6-4a07-960d-e527551098a1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:14.204546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 150/296] 10.222.0.33 () {58 vars in 1463 bytes} [Sat Oct 15 13:35:14 2022] PUT /identity/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d/groups/e33cde9308274a13bd9ceb6aee722c38/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:15.117614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de7a93-e4a2-4b25-81ac-5adf80e6c05e None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:15.118213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de7a93-e4a2-4b25-81ac-5adf80e6c05e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:15.118454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de7a93-e4a2-4b25-81ac-5adf80e6c05e None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:15.121331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 147/297] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:15.128163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:15.128867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:15.129178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:15.165292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:15.167249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:15.322183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 151/298] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:15.930572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de7a93-e4a2-4b25-81ac-5adf80e6c05e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:16.054301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:16.070046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de7a93-e4a2-4b25-81ac-5adf80e6c05e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:16.122540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:16.123318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.123516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.123742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.139813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:16.145449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:16.146364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:16.147152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 148/299] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:16.155835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:16.282392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbe86f-422f-486b-ba49-f2a5aad3f54e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:16.297130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:16.330718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:16.331267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.331636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.331892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.332630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:16.332935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:16.334328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307b2b-2529-4000-8ffa-f192049084cf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:16.348592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 152/300] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:16.357805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:16.514546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d7e-6a29-4eba-8e46-d0b9557296f5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:16.593307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:16.594228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.594781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.595250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.620038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deab8a-8330-4e5f-b01b-3bffb9a1b97e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.620369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deab8a-8330-4e5f-b01b-3bffb9a1b97e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.620596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deab8a-8330-4e5f-b01b-3bffb9a1b97e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.622246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 153/301] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:16.630212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311891e-48a9-4bdf-9b73-09a4593d476a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.630800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311891e-48a9-4bdf-9b73-09a4593d476a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.631260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311891e-48a9-4bdf-9b73-09a4593d476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.642119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:16.670326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f311891e-48a9-4bdf-9b73-09a4593d476a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:16.671516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f311891e-48a9-4bdf-9b73-09a4593d476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:16.741443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:16.742959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:16.790801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 154/302] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:16.793982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efdabd-2ca0-4efa-a4ab-41697ac8db9e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.794352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efdabd-2ca0-4efa-a4ab-41697ac8db9e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.794647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efdabd-2ca0-4efa-a4ab-41697ac8db9e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.797260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 155/303] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:16.804281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22404cd-5c2a-4d82-b9b1-c74da8bd9139 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.804647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22404cd-5c2a-4d82-b9b1-c74da8bd9139 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.804785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22404cd-5c2a-4d82-b9b1-c74da8bd9139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.841370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e22404cd-5c2a-4d82-b9b1-c74da8bd9139 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:16.842582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e22404cd-5c2a-4d82-b9b1-c74da8bd9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:16.870585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 149/304] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:16.880583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:16.940063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:16.952240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 156/305] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:16.953573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689d6-dd45-4ad9-9047-8828331e7efb None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.953853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689d6-dd45-4ad9-9047-8828331e7efb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.954217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689d6-dd45-4ad9-9047-8828331e7efb None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:16.955911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 157/306] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:16.966093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:16.966376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:16.967478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.005062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:17.006312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:17.034154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722500d5-a0c3-4878-956d-5769720136a2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.062330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:17.076366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.077016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.077293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.077567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.079142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:17.081038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:17.083238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 150/307] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:16 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:17.092658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.148054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 158/308] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:17.149627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.262318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2f4e-fabf-4a6b-94dd-7e498099d152 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.291946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:17.330257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.330903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.331175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.331442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.332640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:17.334142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:17.338413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 151/309] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:17.349171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.374097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d88012-4fbf-4648-9c20-f89efa9123fc None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.450299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.450966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.455679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.455679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.475019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:17.490082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:17.491841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 159/310] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:17.495193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.555752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:17.570491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb82a6-d348-4cea-ac6f-6d0635fa2c02 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.616090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.616720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.617106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.617364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.618110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] RBAC: Adding query filter params (group.id=cac350e30d0f454eb2eb4632487075f4, role.id=f76404c6460e4bef90535587cf1814d1, scope.project.id=3816cd3efc054b9b92213f3e63f90330) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:17.618413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:17.620047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:17.631006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 152/311] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/role_assignments?group.id=cac350e30d0f454eb2eb4632487075f4&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=f76404c6460e4bef90535587cf1814d1 => generated 611 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:17.633256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.726452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7b30-f7b8-490c-96d4-72712f420576 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.748198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:17.804993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.805669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.805943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.806214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.823931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-7751fbb3-8e49-4a30-88f9-bc5311f7f081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:17.830306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:17.832197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 160/312] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:17.833683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5175-d04e-47cc-8fb3-039434d0ccc2 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.834797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5175-d04e-47cc-8fb3-039434d0ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.834797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5175-d04e-47cc-8fb3-039434d0ccc2 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.834797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 161/313] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:17.836192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5175-d04e-47cc-8fb3-039434d0ccc2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:17.852552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd697fd3-f884-4506-b63a-864a49abd879 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:17.912393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:17.913029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.913311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.913580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.914507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:17.914868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:17.916599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa0cef-9c6f-41b4-b5b3-10a7ac566d78 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:17.926986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 153/314] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:17.928122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:17.928539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:17.928775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:17.953910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:17.955185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:17.967315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:17.997252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5175-d04e-47cc-8fb3-039434d0ccc2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.056376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.057495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.057964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.058430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.061982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 154/315] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:18.063502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.075595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:18.082978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:18.084519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 162/316] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:35:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:18.085897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.148119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.254789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27aae-a5ec-45c8-817c-4987a9a7b0b0 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.258058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ef85-bbf7-4052-90d3-7fec9e8744eb None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.304994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.306331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.306780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.307053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.310997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] RBAC: Adding query filter params (name=member) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:18.310997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:18.310997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:18.316738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.317752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.318226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.318698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.323885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 155/317] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:18.323885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.343878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.424560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:18.426056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:18.465676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebd4b-17ea-47ea-b52c-8ba4bd44fb1f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.467553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.521246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.522110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.522540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.522970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.524018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:18.524512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:18.526819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:18.538617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 156/318] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:18.539766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.581222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 163/319] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:18.583251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.636659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.688947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443370-ff1a-4cc7-a78c-ae075c26bebd None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.728995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddbb90-efeb-41ee-80ec-a1328a981320 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.745329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.745949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.746226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.746494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.767335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.768081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.768323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.768537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.780866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:18.785801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:18.787324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 164/320] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:18.788718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:18.798940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.863482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:18.866151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:18.889641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:18.893271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658099d-8a2a-410b-a850-72266ba6bc6d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:18.936152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:18.936777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:18.937049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:18.937319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:18.979267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 157/321] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:18.980001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.021937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.023461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.057140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.104426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfebab-a3d4-496a-a110-30458f7a0bb7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.144395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.149180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 165/322] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:19.150129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.160073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.160737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.161014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.161285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] PATH_INFO: `/v3/projects/3816cd3efc054b9b92213f3e63f90330` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.162494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] RBAC: Authorizing `identity:get_project(project_id=3816cd3efc054b9b92213f3e63f90330)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.164008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.165866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 158/323] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:18 2022] GET /identity/v3/projects/3816cd3efc054b9b92213f3e63f90330 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.166501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.287643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf40a-0101-43cf-a3c7-29dad7560f1e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.298059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275371e-b252-4850-8f49-bd53b3f13e8d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.330151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.330517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.330966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.330966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.331257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.332017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:19.332280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.333766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.337025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.338051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.338051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.338263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.339309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.340790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.342461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 159/324] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.347877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.347973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 166/325] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.347973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.432453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.482684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f4f1-d744-4a6c-9eca-1d57b16997cb None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.482978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573981-f704-4d3c-93e1-3de6c0a24df7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.523468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.524168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.524452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.524725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] PATH_INFO: `/v3/projects/e6b6fa4a33ff4049adee2750c4b88956` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.525946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b6fa4a33ff4049adee2750c4b88956)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.527480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.529286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 160/326] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/projects/e6b6fa4a33ff4049adee2750c4b88956 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.530229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.541394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.542089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.542365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.542634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.543976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.545507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.547240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 167/327] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.548336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.617354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.659568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765333-c60d-448c-ac5e-f54fbab330e2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.674520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c220-02b6-4246-89a5-9e9629794dbf None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.700519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.701291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.701652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.702008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.703697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.705459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.707229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 161/328] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.708238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.714602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.724762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.725573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.725918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.726357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.805839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.807353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.841626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed57-bd74-4422-9812-45aee482c270 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:19.881262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:19.881822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:19.882102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:19.882369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] PATH_INFO: `/v3/groups/cac350e30d0f454eb2eb4632487075f4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:19.883537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] RBAC: Authorizing `identity:get_group(group_id=cac350e30d0f454eb2eb4632487075f4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:19.885038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:19.886695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 162/329] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/groups/cac350e30d0f454eb2eb4632487075f4 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:19.886695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:19.898039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:19.961561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 168/330] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:19.962838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:20.000046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:20.036985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062306-5fbc-46d4-b400-c633b6278534 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.080683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.081472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.081840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.082211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.083068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] RBAC: Adding query filter params (group.id=cac350e30d0f454eb2eb4632487075f4, role.id=0a15993814224f1fbf73bd70a958b9c5, scope.project.id=3816cd3efc054b9b92213f3e63f90330) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:20.083381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef09e-097d-46ec-bd0c-e4f04c5c64bb None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.083539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.085193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.095062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 163/331] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/role_assignments?group.id=cac350e30d0f454eb2eb4632487075f4&scope.project.id=3816cd3efc054b9b92213f3e63f90330&role.id=0a15993814224f1fbf73bd70a958b9c5 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:20.096581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:20.148872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.150370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.150817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.151452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.152832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] RBAC: Adding query filter params (group.id=cac350e30d0f454eb2eb4632487075f4, role.id=f76404c6460e4bef90535587cf1814d1, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:20.153346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.155845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.166977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 169/332] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Oct 15 13:35:19 2022] GET /identity/v3/role_assignments?group.id=cac350e30d0f454eb2eb4632487075f4&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=f76404c6460e4bef90535587cf1814d1 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:20.168519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:20.236775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:20.318127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe1eff-f988-4c3c-a068-db5fbbb48a23 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.358948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:20.373331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73e851-31de-4039-93b9-b6cf15c9bec1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.373619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.374270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.374270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.374496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.375210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] RBAC: Adding query filter params (group.id=cac350e30d0f454eb2eb4632487075f4, role.id=0a15993814224f1fbf73bd70a958b9c5, scope.project.id=e6b6fa4a33ff4049adee2750c4b88956) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:20.376062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.377313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.390665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 164/333] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Oct 15 13:35:20 2022] GET /identity/v3/role_assignments?group.id=cac350e30d0f454eb2eb4632487075f4&scope.project.id=e6b6fa4a33ff4049adee2750c4b88956&role.id=0a15993814224f1fbf73bd70a958b9c5 => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:20.427753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.428461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.428741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.429010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] PATH_INFO: `/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.430331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] RBAC: Authorizing `identity:get_project(project_id=ccefdcbe08cc44feb4368c7ef30d7a4d)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.432258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.434508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 170/334] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:35:20 2022] GET /identity/v3/projects/ccefdcbe08cc44feb4368c7ef30d7a4d => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:20.443829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:20.642146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8121c2-04d0-45f6-9111-618f12214b2f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.698444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:20.707730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.708859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.709908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.710337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] PATH_INFO: `/v3/groups/e33cde9308274a13bd9ceb6aee722c38` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.712551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] RBAC: Authorizing `identity:get_group(group_id=e33cde9308274a13bd9ceb6aee722c38)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.715329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3ae5f-2c5d-4922-9959-e01ecb783a59 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.723821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 165/335] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Oct 15 13:35:20 2022] GET /identity/v3/groups/e33cde9308274a13bd9ceb6aee722c38 => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:20.729041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:20.870617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d813d-ac93-418a-aadd-49f8a782a46c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:20.910022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:20.910651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:20.910921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:20.911204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:20.911959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] RBAC: Adding query filter params (group.id=e33cde9308274a13bd9ceb6aee722c38, role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=ccefdcbe08cc44feb4368c7ef30d7a4d) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:20.912278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:20.913719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e592a-2a61-4a1a-bb5c-10dc5ff8959d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:20.920356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 171/336] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Oct 15 13:35:20 2022] GET /identity/v3/role_assignments?group.id=e33cde9308274a13bd9ceb6aee722c38&scope.project.id=ccefdcbe08cc44feb4368c7ef30d7a4d&role.id=19608e06d1c94b169326bd0a33985478 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:23.553543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b13de-f635-41ac-a524-c430b1ddc783 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:23.554071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b13de-f635-41ac-a524-c430b1ddc783 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:23.554071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b13de-f635-41ac-a524-c430b1ddc783 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:23.555860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 166/337] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:23.561870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd8f6-6b7d-4036-b6e4-993e588ab115 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:23.562790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd8f6-6b7d-4036-b6e4-993e588ab115 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:23.563314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd8f6-6b7d-4036-b6e4-993e588ab115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:23.592895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-400dd8f6-6b7d-4036-b6e4-993e588ab115 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:23.594529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-400dd8f6-6b7d-4036-b6e4-993e588ab115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:23.623216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:23.695357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 172/338] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:23.969163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ceeb-2448-4243-bfd8-536165df8b4d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:23.969671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ceeb-2448-4243-bfd8-536165df8b4d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:23.970107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ceeb-2448-4243-bfd8-536165df8b4d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:23.973035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 167/339] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:23.981782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b406a7-4a65-44a0-8888-a2ce6567eb0f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:23.982206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b406a7-4a65-44a0-8888-a2ce6567eb0f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:23.982644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b406a7-4a65-44a0-8888-a2ce6567eb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.018131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-87b406a7-4a65-44a0-8888-a2ce6567eb0f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:24.019375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-87b406a7-4a65-44a0-8888-a2ce6567eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:24.090656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ceeb-2448-4243-bfd8-536165df8b4d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:24.140055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 173/340] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:24.310829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ceeb-2448-4243-bfd8-536165df8b4d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:24.387110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:24.388175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.388657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.389118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.408872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:24.411565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:24.416433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06932cf-4eeb-4c1e-833f-7844f9d2759e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.417046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06932cf-4eeb-4c1e-833f-7844f9d2759e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.417526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06932cf-4eeb-4c1e-833f-7844f9d2759e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.420607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 174/341] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:24.425754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.426342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.426820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:24.443502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:24.444769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:24.445624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:24.445624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:24.445624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:24.445624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 168/342] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:24.455921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:24.457071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:24.457714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:24.578446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:24.592091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 175/343] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:24.678436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b829d-d95c-4f12-88a3-9e6032774f2d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:24.729598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:24.730590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.731012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.731438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.732329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:24.732791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:24.734372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:24.738293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:24.753180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 169/344] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:24.754505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:24.787831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:24.909043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373608-78f3-4d92-adcd-b06783ae2a55 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:24.937709 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008877-338f-49e6-b6eb-88e630fb4ce5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:24.950161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:24.951205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.951694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.952177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.964801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:24.966601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-88ffe295-077e-4f66-8789-f261342c69ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:24.983911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:24.984878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:24.985738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:24.985738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:24.985738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:24.987646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 176/345] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:24.988035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:24.989329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e60f-82aa-42b3-b892-6581f1dbd6b6 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:24.989781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e60f-82aa-42b3-b892-6581f1dbd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:24.990216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e60f-82aa-42b3-b892-6581f1dbd6b6 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:24.992217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 177/346] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:25.000085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e60f-82aa-42b3-b892-6581f1dbd6b6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.010249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:25.011141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.011537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.012020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.013168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:25.015701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5037b-076b-49e0-adc5-2a1cd1a25b4e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:25.058122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 170/347] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:24 2022] POST /identity/v3/users => generated 246 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:25.061075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.061574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.062058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.106239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:25.109042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:25.152087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:25.204773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e60f-82aa-42b3-b892-6581f1dbd6b6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:25.249360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:25.250362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.250890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.251915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.252794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:25.253581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:25.255194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:25.265903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 171/348] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:25.267420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.275496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 178/349] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:25.285999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.463170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:25.471872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ead3a-ab68-4007-8406-4bb2283666a3 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:25.566425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cd23-9902-4a07-b7a6-722586c3d534 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:25.573353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:25.573692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.573975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.574248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.587174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:25.588797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:25.605921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:25.607624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:25.609222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:25.609222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:25.609222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:25.609222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 172/350] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:25.609222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.637772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:25.659572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:25.661366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.661998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.662848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.665147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:25.668696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:25.728673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 179/351] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:25 2022] POST /identity/v3/users => generated 248 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:35:25.728673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.762140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be62-7b71-4a79-8a0e-31ed109ed927 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:25.844231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:25.848248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:25.848957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:25.849469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:25.888818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:25.890734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:25.921423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:25.922444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:25.923481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:25.923481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:25.923481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:25.934107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 173/352] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:25.943235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:25.950769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:25.960128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067b3ee-27b4-4006-8966-3555d9d57775 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:26.043812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:26.046266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.046266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.046266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.046858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:26.047513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:26.050158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ae5b0-b7fd-4e6f-a3a9-9b8afc80c655 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:26.076123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 180/353] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:26.079412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807732-8239-495f-bbf6-4c0400c1b5c4 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.080168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807732-8239-495f-bbf6-4c0400c1b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.080654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807732-8239-495f-bbf6-4c0400c1b5c4 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.087385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 181/354] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:26.087385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36807732-8239-495f-bbf6-4c0400c1b5c4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:26.134867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabcca7-2798-41ee-b466-3976c6f4f040 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:26.167974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:26.179031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:26.179730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.180070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.180446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.181450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:26.181629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:26.183434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f21bc-c5d9-47f8-a6ed-d9627cdff861 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:26.198442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 174/355] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:26.200391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.200391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.200672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.224557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:26.226667 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:26.239252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36807732-8239-495f-bbf6-4c0400c1b5c4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:26.279305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:26.280325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.281043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.281502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.282700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:26.284432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:26.314578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 182/356] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:26 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:26.315927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:26.377983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:26.412597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 175/357] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:26.454527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:26.458621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4896226-3ce4-45e8-b371-c05f07b072a6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:26.503027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:26.503988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.504418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.504838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.505660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:26.507282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:26.540320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 183/358] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:26 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:26.731710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:26.882955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e20eb-48d0-47ac-80df-ea5c9e6de630 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:26.945022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:26.945663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:26.945943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:26.946217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:26.946919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:26.948399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:26.959234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.sql.core [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 15 13:35:26.959234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 15 13:35:26.959234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [parameters: {'id': '58e9cf8b8d454661b72be0536ad1b10a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 15 13:35:26.959234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:35:26.966528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return ref.to_dict() Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:35:26.967462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application yield resource Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.rollback() Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.force_reraise() Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise self.value Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application session.commit() Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 15 13:35:26.968507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._prepare_impl() Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.flush() Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._flush(objects) Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application compat.raise_( Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application flush_context.execute() Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rec.execute(self) Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 15 13:35:26.969491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:35:26.970356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:35:26.971237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [parameters: {'id': '58e9cf8b8d454661b72be0536ad1b10a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:26.973344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 15 13:35:26.975251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:26.984568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 176/359] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Oct 15 13:35:26 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:26.984651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:27.169738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4bc92-ae06-4763-8406-e3225f9161c2 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:27.249526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:27.250697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:27.251174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:27.251634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:27.285112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-481edc73-1e18-45b6-afac-f8acff9f7910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:27.290696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:27.295269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:27.298231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 184/360] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:35:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:27.303998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:27.397440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:27.464308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e879-eb46-4d7e-8c40-e27ac73ab493 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:27.514540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:27.515077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:27.515346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:27.515616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:27.516459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:27.516762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:27.518176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a1294-4add-4417-8a6e-86edceb2eca1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:27.527618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 177/361] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:27.927592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1a6e-d0a5-4c77-95dd-9738b6ba9724 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:27.928040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1a6e-d0a5-4c77-95dd-9738b6ba9724 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:27.928150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1a6e-d0a5-4c77-95dd-9738b6ba9724 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:27.930012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 185/362] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:27.935598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb12ed-7322-4997-b737-db97f8139b70 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:27.936192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb12ed-7322-4997-b737-db97f8139b70 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:27.936192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb12ed-7322-4997-b737-db97f8139b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:27.963315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-11fb12ed-7322-4997-b737-db97f8139b70 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:27.964659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-11fb12ed-7322-4997-b737-db97f8139b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:28.061190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 178/363] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:28.421387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee33a1-493b-45cc-bf6b-1db987924f96 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:28.421913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee33a1-493b-45cc-bf6b-1db987924f96 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:28.421913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee33a1-493b-45cc-bf6b-1db987924f96 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:28.423872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 186/364] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:28.429719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:28.430015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:28.430290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:28.456930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:28.458149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:28.463553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee33a1-493b-45cc-bf6b-1db987924f96 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:28.505894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:28.514778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:28.568429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 179/365] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:28.668715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee33a1-493b-45cc-bf6b-1db987924f96 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:28.725541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:28.726553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:28.727050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:28.727509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:28.746393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:28.752110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:28.752989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:28.753899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:28.760816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 187/366] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:28.766625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:28.909070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bbf8-a7dc-4bd0-9fa9-cdeb18e2a2e4 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:28.945877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:28.946643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:28.946849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:28.947090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:28.947841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:28.948151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:28.949609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:28.959459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 180/367] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:28.964904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:28.991016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.036743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:29.109329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae22b3-ebbb-4f22-9c3c-2b14b294a82f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.156143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:29.184474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.185134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.185412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.185683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.201554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863a77-3ecc-49dc-9c94-cc79c10c2a7b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.207511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:29.217520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:29.218442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:29.219411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:29.222325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 181/368] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:29.226265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.277073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.277711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.277969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.278244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.299064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:29.300955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:29.337301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:29.338312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:29.339164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:29.339164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:29.339164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:29.347390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 188/369] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:29.347889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522912-0145-46cc-a669-a45375a47bb7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.353075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.356199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:29.385121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.386205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.386205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.386368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.387097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:29.387398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:29.391817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:29.398435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 182/370] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:29.404877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.523284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667159-c658-444c-9a49-a620ea292b2f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.594714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.595758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.596270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.596745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.630610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b602f6-ba06-41ff-b586-ada10d237af3 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.638813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:29.641797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:29.670966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:29.671990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:29.673487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:29.673487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:29.673487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:29.674233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 183/371] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:29.681426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.702341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:29.721007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:29.756588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.757242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.757526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.757811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.758491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:29.758801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:29.760318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf255c1-b716-465d-b5a7-19ec0704e26f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:29.783124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 189/372] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:29.789010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4be56-9c4b-4e71-b350-ef04caf94211 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.789332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4be56-9c4b-4e71-b350-ef04caf94211 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.789603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4be56-9c4b-4e71-b350-ef04caf94211 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.791193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 190/373] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:29.792042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4be56-9c4b-4e71-b350-ef04caf94211 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:29.864574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268b19-93ba-4cd1-8ab7-659802df0171 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.908393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.909153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.909432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.909703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.910417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:29.910979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:29.912183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1019-5e0d-49ad-a16e-7486317735af None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:29.931822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 184/374] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:29.931822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.931822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.931822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:29.946378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4be56-9c4b-4e71-b350-ef04caf94211 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:29.950519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:29.951735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:29.996786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:29.997453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:29.997725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:29.998024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.007849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.009386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6cb51a49-bf2c-49da-9eeb-0cc210cd7ec4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:30.028203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:30.029329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 191/375] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:35:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:30.031138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd197-fc05-4162-bc80-16dd2f53ff72 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.032057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd197-fc05-4162-bc80-16dd2f53ff72 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.032607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd197-fc05-4162-bc80-16dd2f53ff72 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.034306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 192/376] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:30.039309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dd197-fc05-4162-bc80-16dd2f53ff72 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.050680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 185/377] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:30.053123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.077984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.103757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.180154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dd197-fc05-4162-bc80-16dd2f53ff72 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.232679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.233388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.233668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.233940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.246659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.248417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ad17883a-63e1-4a7e-8e53-66dba4e7a6d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:30.275244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:30.277188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 15 13:35:30.279133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:30.280249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ad325-3862-4fab-b3ad-7f6213ee7702 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.282801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 193/378] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:30.285353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.286050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.286714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.320307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:30.322739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:30.346313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.347626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.348045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.348594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.349985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:30.350671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.353768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:30.427969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 186/379] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:30.428709 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.456976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 194/380] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:30.458402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.524099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.550020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.628547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08247fec-d6b4-49be-8d17-ebbe960e92ea None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.639828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad069-0b0f-4ad5-bccf-dd991fbf43e1 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.698739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.700520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.701276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.702375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.702886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.704319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:30.704491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.704774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.705217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.705763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.708787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:30.735003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:30.739948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:30.741165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:30.741992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:30.746189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 195/381] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:30.748155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.754552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 187/382] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:30.756700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:30.904146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.915619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e640-3049-47bb-9da2-6ca06f38eb2a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.941005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9ef43-ac1b-4fb2-b0c0-6ce4e5f1c259 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:30.966204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.966785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.966887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:30.967301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.967301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.981597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.983214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:30.987744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:30.988416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:30.988698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:30.988973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:30.989662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:30.989960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:30.991454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:31.001778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:31.002761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:31.003690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:31.003690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.003690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:31.003690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 196/383] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:31.003956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.009503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 188/384] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:31.011284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.129177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c186-863d-4a92-8e03-9c8f524e2d37 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.144922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999713-38ab-4b73-b24e-97b51c833ae3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.171481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.172286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.172667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.172880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.185872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.187368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.187498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.189311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.189596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.189866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.205046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:31.210764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:31.211771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:31.212597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 189/385] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:31.213328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:31.214154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:31.215825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:31.215825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.215825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:31.216097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.216276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 197/386] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:31.216276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.217776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.279659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.347672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e830a-82ed-4db8-a745-c549f554a81d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.349075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec11e87-a27a-4e9e-8275-a91d2516e5fd None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.386448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.387108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.387390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.387659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.388297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.388929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.389206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.389472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.390130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:31.390424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.392325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94e9e-3191-45ee-9e14-10b4c4d42733 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.400291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.401785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.405103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 190/387] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:31.406703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df8e7-442e-4331-871b-63b20c716e68 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.407172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df8e7-442e-4331-871b-63b20c716e68 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.407715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df8e7-442e-4331-871b-63b20c716e68 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.409199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 191/388] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:31.409929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df8e7-442e-4331-871b-63b20c716e68 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:31.420968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:31.422289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:31.423341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:31.423341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:31.423341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:31.423341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 198/389] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:31.423341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.493496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.544061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df8e7-442e-4331-871b-63b20c716e68 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.545722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.569081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889dd07-06de-4f2b-a7d9-813c58cee8f4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.583274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.583928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.584199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.584462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.585132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:31.585424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.586877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.596574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 192/390] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:31.597326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.616895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.617524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.617802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.618066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.618703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:31.619001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.620446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb129cb-8740-49ee-b46f-078056453eae None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.634040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 199/391] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:31.636754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.637533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.637940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.666484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:31.668557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:31.748957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd55c7-92a7-4a7a-9853-03d1f684e04d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.773185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 200/392] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:31.774126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.798026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.798968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.799469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.799965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.810871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.813620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:31.828407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:31.829458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:31.830323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:31.831482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 193/393] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:31.832984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.839234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.866661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:31.921334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724778a9-7678-484e-9231-ed88f625c1c4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:31.962399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:31.963029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:31.963310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:31.963577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:31.964265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:31.964566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:31.966033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:31.982664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 201/394] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:31.982664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:31.996819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb457-4e50-4904-8740-0c2824cdc449 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.032123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.032758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.033052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.033307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.045983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.047736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:32.063268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:32.065055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:32.066755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:32.066755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:32.066755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:32.066755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 194/395] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:32.066755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.122700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdf80-7aca-490a-a574-b8514997d613 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.126306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.167159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.175328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.176447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.176724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.176994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.184520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.185982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:32.198439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:32.199388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:32.200291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:32.204910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 202/396] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:32.205868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.211815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0480190-997d-4c3a-8fae-5c09de914107 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.273052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.274130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.274553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.274958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.276067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:32.276514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.278479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.307680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 195/397] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:32.309154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.331400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3a7a-756e-49bd-a575-2fd13d365724 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.375698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.376535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.376817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.377095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.385505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.386979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:32.400106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:32.401938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 203/398] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:32.402971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.435539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.445986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b9f7-21e0-403c-b00b-1e28924ee2a2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.499701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.500569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.500912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.501216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.504447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.513667 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.515329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:32.532581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:32.534364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:32.535655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:32.535655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:32.535655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:32.535886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c16-212e-43fe-87e1-996dd078398f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.538900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 196/399] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:32.539600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.570227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.570740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.571005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.571269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.571957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:32.572258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.573628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.586032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 204/400] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:32.586860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.653265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d025f97-67fb-4a1b-a4ea-ce831eacfafd None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.676528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.692965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.693589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.693867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.693987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8fe1-8a8a-4429-8554-5de325ef6861 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.694140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.694829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:32.695135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.696652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.712582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 197/401] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:32.713579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.748661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.749637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.750119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.750583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.772645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=b10284800d0248778a9b4ece037e3343, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.774122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.785958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:32.789343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 205/402] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:32 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:32.790196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:32.872341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc488d-acd4-4f36-aa33-5bb820eb45f7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.922308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:32.923092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:32.923360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:32.923622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:32.924408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:32.924711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:32.926223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:32.939234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138b6d-c718-445e-821a-7f82c3a6931c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:32.952238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 198/403] 10.222.0.33 () {56 vars in 1139 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:32.953521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.002742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.003817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.004289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.004766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.005900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:33.006436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.009295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.012121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.030529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 206/404] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:33.032746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.102646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b976-46c4-42f8-b9bd-fb8bdf5819f0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.118094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.149348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.149909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.150175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.150445 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.159247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.160765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.162047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f150-54da-4bc4-9be2-9233a1c8c786 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:33.177990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:33.180835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 199/405] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:33.182685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.216239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.218269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.218742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.219499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/5f309ff57750472c9011ccf17eb7089e/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.246040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=5f309ff57750472c9011ccf17eb7089e, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.247568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.266618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 207/406] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:33 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/5f309ff57750472c9011ccf17eb7089e/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:33.267556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.348882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76878a-21d5-45a3-8df2-a0acf75edabe None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.358166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.427681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.429623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.430506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.431271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.453119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.456800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.469940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9490-9374-4e1a-b37b-6b6c445deb01 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:33.487048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:33.488230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:33.489264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:33.489264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:33.489264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:33.489504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 200/407] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:33.491383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.516391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.517303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.517723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.518155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.518812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.520309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.524148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.547688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 208/408] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:33 2022] POST /identity/v3/users => generated 247 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:33.548689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.670404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.674784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ad36-509c-4a04-8df4-afc5c2232a38 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.694198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc723-0ebb-4bc6-9b5a-e89169ff17e1 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:33.760636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.761443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.761597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.761981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.762492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:33.762791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.764323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.794228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 209/409] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:33.794989 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:33.796326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:33.797166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:33.797924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:33.799582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:33.800345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.800686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:33.803613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:33.828755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 201/410] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Oct 15 13:35:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:33.835294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:33.962592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:33.973778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79513e1-d12e-4d21-8d5b-2d2d2d0730be None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.022856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96b81-f24f-47b9-81a9-9894099b905f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.041382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.042448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.042924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.043393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.057960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.060713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:34.084289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:34.085247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:34.086120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:34.096149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 210/411] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:34.096149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:34.106545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.107227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.107483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.107751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.120177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.121828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:34.139717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:34.140794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:34.141662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:34.141662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:34.141662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:34.141662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 202/412] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:34.148899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:34.161060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:34.271576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ac59-3db6-4d0e-9496-af3f01f15268 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.310018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.310653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.310933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.311200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.311940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:34.312244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.313779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.339948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 211/413] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:34.341776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:34.433312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77dc8-a6dc-4e44-bc1c-e05d08381226 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.494955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:34.503007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:34.520775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.521525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.521949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.522169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.523037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:34.523370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.525518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.553114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a16f-53e1-43f9-b3f2-91ccf851f9a5 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.569281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 203/414] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:34.570357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:34.623871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.624564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.625028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.625295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/cff73b0ad3ad44b4bb9d60912e0bbd62/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.660380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=cff73b0ad3ad44b4bb9d60912e0bbd62, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.661998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.683889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 212/415] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:34 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/cff73b0ad3ad44b4bb9d60912e0bbd62/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:35:34.770170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93820b9c-6587-472d-9d9e-e2f887f74bc3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:34.855211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:34.856249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:34.856780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:34.857236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:34.871395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:34.874372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:34.897362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:34.898311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:34.899162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:34.900105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 204/416] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:34.909858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:35.098283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07794e-d99e-446d-944b-e6a7638a0ae3 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:35.160980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:35.171245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:35.172397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.173352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.173845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.175597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:35.180519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:35.183454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103311c-39a5-435b-9b0e-b9e2441e4a78 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:35.213638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 213/417] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:35.220574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:35.335201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:35.441747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6649b-dca4-4f84-8de7-ecf4fce3918b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:35.506767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:35.507896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.508376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.508856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/4fb1ad7b1aec4c5f99b1341e62d18c04/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.545426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=4fb1ad7b1aec4c5f99b1341e62d18c04, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:35.548365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8c4c-f87d-422c-b3de-688e3b7f4829 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:35.573022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 205/418] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:35 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/4fb1ad7b1aec4c5f99b1341e62d18c04/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:35.630522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5745ac-a543-4a34-a3a6-89e7cccf2ad8 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.630903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5745ac-a543-4a34-a3a6-89e7cccf2ad8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.631195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5745ac-a543-4a34-a3a6-89e7cccf2ad8 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.634100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 214/419] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:35.643043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792a9b-7430-43ae-8eb1-8c5e72855ba5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.643523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792a9b-7430-43ae-8eb1-8c5e72855ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.644031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38792a9b-7430-43ae-8eb1-8c5e72855ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.689322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-38792a9b-7430-43ae-8eb1-8c5e72855ba5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:35.691592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-38792a9b-7430-43ae-8eb1-8c5e72855ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:35.849169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 206/420] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:35.938704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef011-55cb-4ae8-9484-0485839f6542 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.939278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef011-55cb-4ae8-9484-0485839f6542 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.939641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef011-55cb-4ae8-9484-0485839f6542 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.942664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 215/421] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:35.948609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:35.948895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:35.949172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:35.969646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:35.970771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:36.001111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:36.092948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 207/422] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:36.398360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef011-55cb-4ae8-9484-0485839f6542 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:36.467661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:36.560024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef011-55cb-4ae8-9484-0485839f6542 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:36.644617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:36.645292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:36.645563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:36.645838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:36.660660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-28a3f7c5-be13-44f3-ae8f-b6b45b4a2224 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:36.666039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:36.667756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 216/423] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:36.669343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721533-3c33-4660-b919-16def84b3b51 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:36.670736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721533-3c33-4660-b919-16def84b3b51 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:36.670736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721533-3c33-4660-b919-16def84b3b51 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:36.675413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 217/424] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:36.676389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721533-3c33-4660-b919-16def84b3b51 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:36.689854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97bae-0a91-4ca9-be3e-26b3d42b6e62 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:36.745002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:36.771377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:36.774194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:36.774957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:36.775714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:36.800998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:36.809499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721533-3c33-4660-b919-16def84b3b51 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-fe5131f8-f2d5-4cb7-850b-c44bb869bb6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:36.818643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:36.820431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:36.821947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:36.832564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 208/425] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:36.832564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:36.832564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:36.832564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:36.855351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:36.856696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:36.876609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:36.888758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:36.890349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:36.891215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:36.891995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:36.893848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:36.895215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:36.898656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:36.920101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 218/426] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:36.923037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:36.948083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 209/427] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:36.949024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.143630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097c56-79ce-448b-9ae0-97138eff5a81 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.180427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d13c-73ca-4317-ba2c-fecc30c1916d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.191191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.236075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.236714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.236989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.237258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.237942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:37.238246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.239690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:37.256886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.257549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.257830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.258099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.260410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 219/428] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:37.269503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.281215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.282837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:37.299443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:37.308877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:37.310503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:37.312092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:37.312092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:37.312092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:37.316344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 210/429] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:37.319117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.394589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046be6d-caa8-49d2-b258-db3fcec9bb8c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.438755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.439417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.439815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.440097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.449878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2e5e6-6d9c-458a-98a2-fbc0e4c222ec None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.454777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.456528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:37.475889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:37.479233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:37.481161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:37.481161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:37.481161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:37.481161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 220/430] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:37.481161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.490787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.491679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.492104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.492469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.493366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:37.493766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.495356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:37.510476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 211/431] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:37.511514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.512149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.591029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.618788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8832-f40a-487c-823e-c127bfea3514 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.661318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbf37-367d-41a7-b0c2-00dffe1e6e11 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.661655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.662282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.662567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.662842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.677137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:37.683995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:37.684961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:37.686227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 221/432] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:37.686901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.734742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.735723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.736211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.736715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.737761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:37.738248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.740804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:37.770408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 212/433] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:37.772241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:37.851981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.889101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab91a-29f5-47d6-b6b8-d2409a95e5a0 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.951289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8a5d-ac71-41db-9d55-4e1be5f9aeec None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:37.967418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:37.969807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:37.970571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:37.971918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:37.989639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:37.991824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:37.995656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.014867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.016002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.016479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.016947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.018151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:38.018674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.021332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:38.025259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:38.026998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:38.028789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 222/434] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:38.029771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.039777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 213/435] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:38.047887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.229199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac2d4a-c497-4f31-86f0-6d78ece1724c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:38.274291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c444-982e-4051-805a-9f820c12c72a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:38.300951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.302523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.303268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.304034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.305688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:38.306516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.309831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.345093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.346187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.346704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.347311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.347949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 214/436] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:38.349763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.362374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.364968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:38.386329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:38.387306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:38.388244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 223/437] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:38.390286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.404412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:38.431013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:38.520631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e558f4-b345-4fef-8115-dbed4f25197f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:38.565542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb193-f3fd-4d5d-8b64-ff7042f206b7 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:38.586368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.587406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.587817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.588246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.608579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.611054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.611683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.611881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.612001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.612253 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-d05e011a-0ab6-480a-aedf-b82d28c6a52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:38.640222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:38.641462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:38.642414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:38.642414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:38.642414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:38.643955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 215/438] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:38.645643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657562c-ce96-4ee0-a419-a852231d86c8 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.646109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657562c-ce96-4ee0-a419-a852231d86c8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.646516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657562c-ce96-4ee0-a419-a852231d86c8 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.648297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 216/439] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:38.649346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657562c-ce96-4ee0-a419-a852231d86c8 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.706583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.708704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad440e9a-302a-4dfa-904a-014a4ab9409c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.721495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:38.790627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:38.804392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657562c-ce96-4ee0-a419-a852231d86c8 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:38.854901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:38.855707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.856144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.856550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.857493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:38.857995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:38.860459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9783-cc5e-4073-8ef7-17e5a691f35f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:38.861869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 224/440] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:38.863420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee427d-3a99-44ec-a940-64f1506f1504 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.863874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee427d-3a99-44ec-a940-64f1506f1504 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.864295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee427d-3a99-44ec-a940-64f1506f1504 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.866095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 225/441] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:38.866907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee427d-3a99-44ec-a940-64f1506f1504 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:38.888439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 217/442] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:38.890266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:38.890790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:38.891248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:38.913572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:38.915182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:38.995930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee427d-3a99-44ec-a940-64f1506f1504 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.004450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.015090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 218/443] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:39.016653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.054930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.055656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.056216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.056663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.057471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:39.057976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:39.060435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f0d28-53d8-472b-9f07-1e61fcbf642e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:39.087655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 226/444] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:39.087655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.087655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.087655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.106679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:39.108244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:39.169225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.201147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8a8c5-828b-43c6-a2ad-843315ce0405 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.212277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 227/445] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:39.212277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.273382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.274535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.275023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.275491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.294226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:39.296231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:39.316523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:39.318217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:39.320594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:39.320594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:39.320594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:39.320594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 219/446] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:39.320594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.385788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.397276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b348b3-53a0-43e1-9ec8-a2aa6a32cd4e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.461414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.462378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.462815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.463245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.512566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0add4-7f59-40d6-b0bb-5b132d7f7e85 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.562800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.571597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.572478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.572929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.573375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.582399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:39.584152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:39.584329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:39.585847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:39.602095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:39.603947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:39.605029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 220/447] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:39.606407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.723426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.732965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 228/448] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:39.734439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.755284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1148-e461-4df4-96a7-8a1e2c017ae0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.795053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.795845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.796263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.796707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.809034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:39.814923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:39.816651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 221/449] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:39.818236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.864198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f332b-09ca-459b-8a09-258beb84e4c1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:39.894121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:39.910719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:39.911636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:39.912029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:39.912384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:39.913231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:39.913648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:39.915638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:39.935274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 229/450] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:39.936704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:39.958380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddaa48-3079-40f1-bd5c-21ae9cd6ffe7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.003845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.004603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.004991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.005393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.013654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.018751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:40.024940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:40.026854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:40.028092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 222/451] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:40.029522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.073149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd832e-ab41-486d-aa52-857a9b03e7d4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.121469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.123325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.123765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.124236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.125489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:40.125963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.128488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.172575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d7850-d650-46ee-a5e7-e04c6ea6a1a7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.192632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 230/452] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:35:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:40.193982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.199104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.222477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.223464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.223934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.224286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.241571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.244117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:40.264412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:40.266316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:40.267685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:40.267685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.267685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:40.267685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 223/453] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:40.267685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.334885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f097-03e8-4c50-9f8a-b3a93ed2f711 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.352241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.379699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.380728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.381215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.381691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.382883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:40.383386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.386037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.391848 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e133c5-95b0-4a01-b0a8-7df760f1f840 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.408633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 231/454] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:40.408633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.433388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.434190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.434552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.435082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.444152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.445807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:40.459567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:40.461369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 224/455] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:40.463676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.498861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.545765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3084e69-f858-4850-a332-87aa306ec382 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.592422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.593155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.593679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.594094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.595205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:40.595599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.597332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.604884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035d0c5-71c6-40c5-a153-ed9acf6ffada None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.607386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 232/456] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:40.608436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.656132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.656861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.657135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.657403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.658429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.670555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.672356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:40.695336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:40.696620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:40.697620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:40.697620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.697620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:40.697620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 225/457] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:40.698787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.741226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eff42-fe59-4ddd-983b-86a922a9e689 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.782710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.783473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.783842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.784283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.785135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:40.785485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.787143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.801192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 233/458] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:40.802343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.814674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.847740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76078391-4d0e-425d-8c9d-05b0c7c9fdfa None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:40.894747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:40.895742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:40.896221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:40.896658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:40.913983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:40.916448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:40.941268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:40.943032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:40.944770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:40.944770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:40.944770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:40.944770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 226/459] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:40.944770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:40.958571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:40.963667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb4f-24cf-468d-8bae-a190226d0e9d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.009737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.010786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.011278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.011745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.012943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:41.013424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.016270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.036197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 234/460] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:41.037110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.088884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47359-1a84-4796-8868-f89cc4ad421e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.122052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:41.134108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.135099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.135482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.135979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.154522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.157711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.162234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99d8e-6dad-435b-b230-f20aa64767d4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:41.185598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:41.187501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:41.189256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:41.189256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:41.189256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:41.189256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 227/461] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:41.190704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.208489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.209115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.209402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.209668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.210355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:41.210661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.212280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.227816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 235/462] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:41.228901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.252669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:41.367914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec4e1-cbb0-47be-a5b6-9dd350d7295a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.371838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f283-df1c-47f8-a82c-6d2200e55816 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.418456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.419352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.419719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.420118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.423829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.424660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.424996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.425321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.426073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:41.426425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.427981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.429632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.431682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.443360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 236/463] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:41.444391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:41.447057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:41.448720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 228/464] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:41.451046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.517028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:41.564958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:41.588821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d19b-d4b3-4068-8a8a-68737a7039a3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.593343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385eb28-8333-4507-ad4a-a52a7f2a544b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.635373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.636310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.636643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.637067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.638120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:41.638601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.641178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.643319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.644279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.644713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.645162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.646170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=b10284800d0248778a9b4ece037e3343) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:41.646660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.649212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.658361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 237/465] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/role_assignments?user.id=b10284800d0248778a9b4ece037e3343&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:41.659431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.667315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 229/466] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:41.668727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.828139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:41.832819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc432c-43df-40af-8c9b-b14e3144db4c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.857952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d15d-3e8a-4eb4-9540-cff2fd973b14 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:41.892625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.892916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.893267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.893696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.905672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.908497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:41.909312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:41.909721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:41.910059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.910206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:41.924859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:41.927426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:41.931755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:41.933622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 230/467] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:41.935152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:41.954543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:41.955770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:41.956897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:41.958082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 238/468] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:41.959280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:41.964037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:42.083442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd168-9040-4bf6-b643-c79df5771087 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.129008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.129806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.130210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.130623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.131499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:42.132157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.133961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.149435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 231/469] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:42.150917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.164509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3bbe-92a4-4330-b71a-2cba3d0c5066 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.182455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:42.232338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.233338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.233757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.234208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.248853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.251650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:42.274114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:42.275107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:35:42.276073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:42.276599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 239/470] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:42.277641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.295728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e302d7-62db-4d3d-81c9-2201b450422f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.357814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.359202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.359750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.360295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.361955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:42.362547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.367882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.386387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:42.402169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 232/471] 10.222.0.33 () {56 vars in 1139 bytes} [Sat Oct 15 13:35:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:42.403467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.469852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee002f9-bba7-4a96-9b6f-9df0957b6835 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.510816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.511488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.511771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.512070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.512783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:42.513098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.514555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.532390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 240/472] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:42.537143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.538408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:42.579593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feeff-3e25-455a-81f8-4ed19a2a29d8 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.645064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.646042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.646607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.647091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.648482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=5f309ff57750472c9011ccf17eb7089e) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:42.649021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.651990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.670346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 233/473] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:42 2022] GET /identity/v3/role_assignments?user.id=5f309ff57750472c9011ccf17eb7089e&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:42.670346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.744883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e339-621b-4945-bdd8-4157b614e680 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.799508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:42.826258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.826968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.827413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.828564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.830053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:42.830593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:42.833273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:42.871973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 241/474] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Oct 15 13:35:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:42.877667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:42.904973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41a27-60fa-4cfd-bd3f-3a3f025a12bd None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:42.955749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:42.956514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:42.956878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:42.957072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:42.974361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:43.083871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760a3-a056-4ed2-b6fa-9d2334e01182 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:43.084454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:43.088670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:43.131133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:43.132355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:43.132618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:43.132795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/ecc00888b1344a4fbc4fb5fd383791ee/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:43.152144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=ecc00888b1344a4fbc4fb5fd383791ee, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:43.153642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:43.178786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 242/475] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:42 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/ecc00888b1344a4fbc4fb5fd383791ee/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:43.184738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:43.302808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:43.417341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 234/476] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:43.425155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:43.465884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffbd8b-008b-4237-aa70-ac80eb30d969 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:43.511295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:43.513460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:43.513593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:43.513969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:43.518044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:43.604752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:43.606613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:43.649919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:43.664463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252867c-9871-4843-8074-0578fa92a62d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:43.754833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:43.755514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:43.756075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:43.756358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:43.780663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:43.782259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:43.814938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 243/477] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:43.817705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:43.819326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:43.820926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:43.820926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:43.820926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:43.820926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 235/478] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:43.825599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:43.831326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.105783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b731b-8dc9-4059-954a-83a97094c129 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.110550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:44.134579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246a840-bd13-423f-8b54-f6ac3f9ffdb5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.144499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:44.164806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.166047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.166536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.166969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.188863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.192105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:44.194832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.195832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.196322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.196776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.197718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:44.198193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.199801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08425d3b-0acb-4f80-99f8-89a29d762d0a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:44.214415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 236/479] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:44.216296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aeffc-91a7-425a-be26-21a727268010 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.216757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aeffc-91a7-425a-be26-21a727268010 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.217191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aeffc-91a7-425a-be26-21a727268010 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:44.223062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:44.224178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:44.225185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:44.225185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:44.225185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:44.225185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 244/481] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:44.225655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 237/481] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:44.226019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.227765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.228385 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.228873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.250618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:44.252364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:44.365508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 238/482] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:44.367144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.442165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242e669-45e3-4a0d-961f-59fb51e232f0 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.558506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.559597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.560146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.560619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.573800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.577066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:44.604383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:44.606857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:44.607723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:44.608607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:44.609126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 245/483] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:44.620625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.627009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e32fd-0068-4600-a4e2-35c433d8ee10 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.700440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.701544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.702940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.703233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.704790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:44.705102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.706584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:44.727062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:44.739009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 239/484] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:44.745697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.886904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bd86-cb17-4206-a2f6-5d39166a0f63 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.917109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a83a5-f7cf-4e4c-9685-f3d867aa0919 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:44.937454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.938538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.939030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.939514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.943902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:44.943902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.943902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:44.962682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 246/485] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:44.964538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:44.981259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:44.982075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:44.982496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:44.983324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:44.992781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:44.994649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:45.009869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:45.011560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:45.014043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:45.016006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 240/486] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:45.017698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:45.022389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:45.143841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35723a-d644-4b4b-b826-f628009ec1c8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.144082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42eec-e7e5-4d40-a3c2-dffe0273370e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.145522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:45.184887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.185512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.185784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.186050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.186634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.186820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=cff73b0ad3ad44b4bb9d60912e0bbd62) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:45.187176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:45.187424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.187654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.191826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.192087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:45.195902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 241/487] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:45 2022] GET /identity/v3/role_assignments?user.id=cff73b0ad3ad44b4bb9d60912e0bbd62&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:45.196850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:45.212692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:45.222824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:45.224461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:45.225916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:45.233848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 247/488] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:45.235960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:45.420124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:45.485875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16eb37-d527-4d86-a7c2-508b37fd96ed None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.498639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100b5c-b82f-48ad-9e64-608ab0b9cba1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.530556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.532355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.532876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.533348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.534300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:45.534939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:45.536689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:45.552103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 242/489] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:45.563459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:45.573813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.575034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.575526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.576059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.579607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:45.580229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:45.583104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:45.602391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 248/490] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:45.612042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:45.693411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:45.817116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a303d-dec9-4fa9-a095-58b5ab561c20 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.887533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64324d-af02-42b9-abbc-a98df37fc07c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:45.893802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:45.922263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.922800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.923221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.923525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.924516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=4fb1ad7b1aec4c5f99b1341e62d18c04) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:45.924826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:45.926780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:45.941948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 243/491] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:45 2022] GET /identity/v3/role_assignments?user.id=4fb1ad7b1aec4c5f99b1341e62d18c04&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:45.943322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:45.944529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:45.944943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:45.945424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:45.981481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:45.984740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-f75c1cda-4cba-40cf-bc4a-a059fc5b4a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:46.024152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:46.025660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:46.027107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:46.027107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:46.027107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:46.027107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 249/492] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:46.033257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:46.299853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a317aee-3da1-4b48-b088-356e786be87b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:46.372954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e320fe-60fa-4443-93f3-8355a9981480 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.373239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e320fe-60fa-4443-93f3-8355a9981480 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.373540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e320fe-60fa-4443-93f3-8355a9981480 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.375273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 250/493] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:46.381328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e431-66ba-48a5-aa8a-f82fef2d9a17 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.381604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e431-66ba-48a5-aa8a-f82fef2d9a17 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.381936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e431-66ba-48a5-aa8a-f82fef2d9a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.385330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:46.386309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.386756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.387194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.388312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:46.388804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:46.391274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:46.409955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-df62e431-66ba-48a5-aa8a-f82fef2d9a17 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:46.411241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-df62e431-66ba-48a5-aa8a-f82fef2d9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:46.427876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 244/494] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:46.436411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:46.534621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 251/495] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:46.537563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212b1e-5a2e-4a40-a8fb-e01d604871ca None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.538391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212b1e-5a2e-4a40-a8fb-e01d604871ca None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.539122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212b1e-5a2e-4a40-a8fb-e01d604871ca None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.548066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 252/496] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:46.552513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.553500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.554215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.565016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:46.599233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:46.611692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:46.617292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:46.736431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa6b9-7fe6-452a-ade7-4078f54c46da None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:46.822615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 253/497] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:46.823708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:46.824913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:46.825394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:46.825866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:46.850936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:46.853608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:46.873741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:46.900859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:46.901997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:46.902932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:46.904053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 245/498] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:35:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:46.919822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.124247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76c9e-2548-40f1-9e54-0c2873a119e6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.149825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.165413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b174ca-42c7-4a8a-98c5-699b27fe1d2e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.195834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.195834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.195834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.195834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.196254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:47.196254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.196254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.231828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 246/499] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:35:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:47.233239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.236193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.237011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.237291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.237602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.255138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.270795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:47.280927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:47.282236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:47.283064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 254/500] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:47.288627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.395922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9287b57-273a-4ce8-abee-e423c1dd58b6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.432177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.433687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.433978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.434249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.446600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.448687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:47.467884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:47.469429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:47.471285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:47.471285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.471285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:47.471285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 247/501] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:47.471514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.478394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2486c-79c6-44e4-9bfe-1f61dfab2d8e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.505375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.521126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.522092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.522539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.522989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.523940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:47.524428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.526127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.536654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 255/502] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:47.537877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.618285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.623155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cf402-5536-4f6d-ab3e-b9ae80f4026b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.664435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.665007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.665295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.665673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.678400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.678603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246e13-e86c-4f64-b3d7-7f7f40f047ef None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.680055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:47.696209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:47.697448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:47.698470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:47.698470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.698470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:47.698470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 248/503] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:47.699056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.726607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.727461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.727915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.728344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.729810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:47.730309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.732261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.755611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 256/504] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:47.755611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.812168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.843728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b8e-4633-4c5f-bc3a-24e87acfddb1 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.886347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.887428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.887978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.888462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.903842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfff73-da46-4e66-bc86-f8c3b4d333f6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:47.904573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.906839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:47.926397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:47.927712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:47.929780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:47.929780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:47.929780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:47.930061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:47.936170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 249/505] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:47.938094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:47.950308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:47.950952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:47.951572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:47.951866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:47.952577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:47.952902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:47.955958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:47.975562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 257/506] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:47.976571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.082595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da2201-8997-4a2a-ae8a-2581f38c4db4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.124726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:48.138983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.140014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.140315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.140589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.151711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.152379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53445e0f-06c9-49ad-a2ce-880a7bef0e9d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.153708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:48.169474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:48.170497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:48.171570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:48.179465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 250/507] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:48.180805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.214865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.215494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.215771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.216065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.216725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:48.217023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.219431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.240321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 258/508] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:48.240321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.298620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:48.328801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7c5b-21be-4a0f-a417-872a1a6d9c18 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.369584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.370261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.370537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.370948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.371996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca90d-79c3-4e23-880e-edf0b39a4074 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.372111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.373545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.408232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 251/509] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:35:48 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:48.409258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.414818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.415809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.416241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.416687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.417914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:48.418417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.420749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f4ad0-8c88-47b7-be31-4b31fcd27b7a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.442897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 259/510] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:48.444133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261714c1-5fcd-4c08-94b0-978b66d6ea71 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.444418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261714c1-5fcd-4c08-94b0-978b66d6ea71 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.444694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261714c1-5fcd-4c08-94b0-978b66d6ea71 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.446082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 260/511] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:48.446844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261714c1-5fcd-4c08-94b0-978b66d6ea71 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.492282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:48.586094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:48.588212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72079d4-f106-484b-bee8-19a6804efd23 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.598121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261714c1-5fcd-4c08-94b0-978b66d6ea71 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.637943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.639108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.639108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.639108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.649656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.651714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.653485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.654175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.654429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.654697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.657888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=b10284800d0248778a9b4ece037e3343, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.658357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-04bb5a6b-e717-4321-ad91-5c0da1cf539f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:48.672122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:48.674152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:48.676301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:48.678192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 252/512] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:48.680534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69defe7e-ba3a-4062-9c16-570af92ce57f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.682500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69defe7e-ba3a-4062-9c16-570af92ce57f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.682500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69defe7e-ba3a-4062-9c16-570af92ce57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.687598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 261/513] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:48 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:48.688860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:48.721139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-69defe7e-ba3a-4062-9c16-570af92ce57f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:48.723710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-69defe7e-ba3a-4062-9c16-570af92ce57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:48.893074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730171-9fce-47fa-82aa-af982d9c0718 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:48.899961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 253/514] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:48.904371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb8f8-4f77-4f54-ba65-399d268d1210 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.908295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb8f8-4f77-4f54-ba65-399d268d1210 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.908565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb8f8-4f77-4f54-ba65-399d268d1210 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.910473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 254/515] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:48.920595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.920851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.921260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.945071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:48.946419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:48.964969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:48.966049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:48.966528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:48.967070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:48.968217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:48.969028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:48.970969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:48.980955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:48.997548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 262/516] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:35:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:49.008364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:49.058403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:49.084714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 255/517] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:49.235310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450c52-f8a6-441a-bcf2-15b98de53163 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:49.287669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:49.288749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:49.289248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:49.289725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:49.394387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:49.396510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:49.416817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:49.501579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:49.521551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 263/518] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 15 13:35:49.528187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:49.680243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c17ee-aa2e-447c-83cb-3cf4ff821083 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:49.703899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:49.738796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:49.739738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:49.740189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:49.740597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:49.755864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:49.757593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:49.765932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36419a-b22d-409d-834d-3a988dec7c0f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:49.790107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:49.791938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:49.794640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:49.794640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:49.794640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:49.794640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 264/519] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:49.794640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:49.819505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:49.822007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:49.822661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:49.823326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] PATH_INFO: `/v3/services/network` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:49.825169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:49.828882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:49.852706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:49.854671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:49.856366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 256/520] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:49 2022] GET /identity/v3/services/network => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:49.857874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:49.897218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:49.998025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40470f2d-e7d2-49e4-b70a-9566c6c91eba None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.001126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ac7a-58d6-480e-a6bb-574090333f92 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.041319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.041796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.042143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.042480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.043207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:50.043576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.045114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.059570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 257/521] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:50.060635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.085430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.087663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.088813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.089531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.092567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.096389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:50.127772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:50.129694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:50.131268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:50.134850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 265/522] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Oct 15 13:35:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:50.134850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.172792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:50.193436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d781-107d-4d2f-8052-30fb1107f8c6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.213898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:50.238258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.238676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.239044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.239396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.240163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] RBAC: Adding query filter params (name=network) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:50.240527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.242013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.247778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 258/523] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:50.253769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.365697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee48df-62fb-4c8c-91e2-c54df90f4ddd None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.408112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.408913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.409248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.409613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.415777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e69-d2f2-4ea8-b5fa-cd339af6bd65 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.417584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.419147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:50.434144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:50.436039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 266/524] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:50.438165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.485030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.486025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.486499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.486964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.488122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:50.488644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.491218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.499259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 259/525] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:50.500903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.535383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:50.560472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:50.564953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcac2f-2672-45cb-86de-d6434e5f10fc None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.608218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.609170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.609636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.610088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.610806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] RBAC: Adding query filter params (type=network) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:50.611122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.612630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.620425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 267/526] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:50.620942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.688770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffff2-20fe-4fd8-aaa2-19236b9cc96d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:50.807738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:50.809228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:50.810019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:50.810693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:50.812261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:50.813007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:50.816157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:50.842267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 260/527] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:50.853271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:50.956852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef191c-35ad-4418-a480-941929bfd9ac None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:51.022905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:51.054008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:51.054652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:51.054929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:51.055204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:51.055893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:51.056218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:51.057616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e4e1-8025-479d-a543-015cbc16ba8c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:51.079029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 268/528] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:51.079724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044715-f226-478e-919b-005d5e3b81d0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:51.141936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:51.142861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:51.143303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:51.143769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:51.145050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=ecc00888b1344a4fbc4fb5fd383791ee) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:51.145571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:51.148130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9de9-79f1-4dc2-916a-4eb98d087039 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:51.159488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 261/529] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:50 2022] GET /identity/v3/role_assignments?user.id=ecc00888b1344a4fbc4fb5fd383791ee&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:51.733718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eb47-59ed-454c-a627-24b541b21d3c None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:51.734213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eb47-59ed-454c-a627-24b541b21d3c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:51.734918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8eb47-59ed-454c-a627-24b541b21d3c None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:51.737913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 269/530] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:51.743907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90697e-81db-40d8-b854-3b20bc31f88e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:51.744183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90697e-81db-40d8-b854-3b20bc31f88e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:51.744455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90697e-81db-40d8-b854-3b20bc31f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:51.768970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ee90697e-81db-40d8-b854-3b20bc31f88e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:51.770178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ee90697e-81db-40d8-b854-3b20bc31f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:51.885186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 262/531] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:51.999587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ab38-90d2-43ce-ab8a-9f0365c3d63d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:52.000424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ab38-90d2-43ce-ab8a-9f0365c3d63d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:52.000424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978ab38-90d2-43ce-ab8a-9f0365c3d63d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:52.003095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 270/532] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:52.009008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:52.009304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:52.009555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:52.037698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:52.038920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:52.134197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:52.146422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 263/533] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 15 13:35:52.289127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978ab38-90d2-43ce-ab8a-9f0365c3d63d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:52.343471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:52.503109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978ab38-90d2-43ce-ab8a-9f0365c3d63d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:52.518103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:52.572602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:52.573184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:52.573455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:52.573722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:52.604550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:52.610422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:52.611442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:52.612319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:52.615169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 271/534] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:52.622302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:52.723856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9aa85-47b3-45ea-b059-b1d455d3694a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:52.772802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:52.795308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94814-bf57-454e-8d83-484cb1061fb8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:52.804656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:52.805239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:52.805518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:52.805790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:52.834763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:52.840538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:52.841525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:52.842392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:52.847411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:52.848373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:52.848872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:52.849360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:52.850239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:52.850345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 264/535] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:52.850834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:52.852561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:52.856774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:52.863442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 272/536] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:52.872963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:52.962597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:53.004652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2094-20bf-4d82-94bb-90409a40d058 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.035852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5ce-3f7b-410f-99d2-14bb5849365e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.071672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.071672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.071672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.071672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.072513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:53.072513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.072513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.086597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 265/537] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:53.093899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.097724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.098387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.098665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.098933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.111362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.112961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.117614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:53.146865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:53.147984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:53.148880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:53.148880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:53.148880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:53.155870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 273/538] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:53.159436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.332924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd835b-abc5-4790-838a-6c2373f368a9 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.392348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:53.393954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3564787-0033-4c26-95f3-8fa10438d150 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.439948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.441050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.441554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.442031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.463399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.466925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.478609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.479707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.480242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.480720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.481667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:53.482206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.484123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:53.505291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:53.506370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:53.507315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:53.507315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:53.507315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:53.509673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 266/539] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:53.515842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 274/540] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:53.518642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.523202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.668469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:53.699123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574ce9-a318-4869-96e0-421e64e633b9 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.764891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626554c-d098-4e64-b2b2-dca0467d7d05 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.781136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.781809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.782124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.782407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.792887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.794544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:53.810231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:53.811296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:53.812781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 275/541] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:53.818106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.884654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.885698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.886184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.886674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.887543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:53.888097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.889805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.917584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 267/542] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:53.937243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:53.942421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937147-67dd-4efa-b4b1-af4c50dd70a6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:53.958697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:53.983531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:53.984229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:53.984510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:53.984783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:53.985553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:53.985860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:53.987352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a3d2d-44ca-4fe3-9999-871f87935fd1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:53.992956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.013922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 276/543] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:54.013922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800af6e-79b1-4011-945f-b3e38ac4b137 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.013922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800af6e-79b1-4011-945f-b3e38ac4b137 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.013922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800af6e-79b1-4011-945f-b3e38ac4b137 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.019926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 277/544] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:54.021668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800af6e-79b1-4011-945f-b3e38ac4b137 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.096586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a0768-fbf5-47f8-9e34-61449da0dd48 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.135251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.135954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.136233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.136504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.146516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.149077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.158958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800af6e-79b1-4011-945f-b3e38ac4b137 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-517cc72a-4b37-4701-879f-24f3112d1022 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:54.165876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:54.166905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:54.168094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 268/545] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:35:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:54.169824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.169824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.170031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.197464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:54.198981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:54.203012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.203907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.204285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.204660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.218177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.220142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:54.238535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:54.240108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:54.242089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:54.242089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:54.242089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:54.242089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 278/546] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:54.242588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.276086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.312102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 269/547] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:54.313277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.357374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.391739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad40e70-ad24-475d-aca9-1792564498b5 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.443432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ddf4e-d594-4301-a8f9-6b99ce2337f5 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.443675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.444126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.444407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.444680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.445713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:54.446026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.448680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6df0b-d521-474e-a199-98930115ab57 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.476626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 279/548] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:54.479008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bc2a-aec9-4ebd-a454-e81539b0f10f None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.479408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bc2a-aec9-4ebd-a454-e81539b0f10f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.479686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bc2a-aec9-4ebd-a454-e81539b0f10f None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.481499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 280/549] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:54.483396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.488290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.494475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.494475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.494475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.508451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 270/550] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:54.508451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.519592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:54.521207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:54.611813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 281/551] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:54.611813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.625869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.644229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.652777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4800-d1f7-45c9-8858-408699e7ed6f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.694077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.694855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.695263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.695611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.743204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119a17b-9534-463d-95ff-b2f045979f09 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.785000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.785652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.785928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.786195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.794014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.795727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.805555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.807138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccd34f-afcc-4986-b1ad-5bac587a3b7d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:54.817560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:54.818555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:54.819475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:54.821041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 282/552] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:54.821223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.902617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.923205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:54.925924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 271/553] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 15 13:35:54.928297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b7e4-622b-4fdc-8e2f-f0498196fc67 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.928764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b7e4-622b-4fdc-8e2f-f0498196fc67 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.929229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b7e4-622b-4fdc-8e2f-f0498196fc67 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.937262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 272/554] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:54.938243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b7e4-622b-4fdc-8e2f-f0498196fc67 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:54.956639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e193-21d1-4034-b4e4-ffb84bd507ab None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:54.993108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:54.993840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:54.994240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:54.994674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:54.995441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:54.997128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.016880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 283/555] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:35:54 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:55.018313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.062089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b7e4-622b-4fdc-8e2f-f0498196fc67 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.112198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.113187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.113591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.113982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.115035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:55.115483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:55.117823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.139845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 273/556] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:55.141078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.182661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346243-24ee-4625-b176-5d010e90ece0 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.209390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:55.222739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:55.231741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.232583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.232873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.234321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.247690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-917a9397-edf9-46ae-892f-6aa827747c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:55.253328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:55.261060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 284/557] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:55.261916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.262682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.262682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.282783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:55.283540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:55.303722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c95d87-91b4-40f9-be3b-07fb16dbe10a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.347820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.348497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.348772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.349039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.362051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:55.363761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:55.380045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:55.381550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:55.382600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:55.382600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:55.382600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:55.382600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 274/558] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:55.382600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.406997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 285/559] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 15 13:35:55.408160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.573937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:55.592637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941d8d-001a-4212-a66d-568f548ba768 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.595116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28cee-56bf-41a7-a90e-86b346b16e20 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.643919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:55.655635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.657355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.658039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.658707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/560f0a24a22f40048578a6e9ffb36927/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.667463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.668573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.669092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.669621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.670853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:55.671419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:55.673973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.688062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=560f0a24a22f40048578a6e9ffb36927, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:55.689942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 286/560] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:55.691162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.692137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.731820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 275/561] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:55 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/560f0a24a22f40048578a6e9ffb36927/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:55.731820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.859258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427236e-2113-4682-8256-c1a09c8d4940 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.901817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.902896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.903384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.903897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:55.905016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:55.905568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:55.907229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:55.927819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc58829-db59-4065-93d2-789c1e41789c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:55.928585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 287/562] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:55.929809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:55.987069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:55.993009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:55.993778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:55.994678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:55.994678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.010700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:56.015733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.017423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:56.052964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:56.054825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:56.057085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:56.057085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:56.057085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:56.057085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 276/563] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:56.057952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.070554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a80c-94a7-4348-86d6-7043cee4f77a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:56.133100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:56.134042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:56.134766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:56.135480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.136716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.139074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.168125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 288/564] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:35:55 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:35:56.169749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.258785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732541-2595-4c19-abbb-e6cdd3ce582b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:56.335735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:56.337525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:56.338451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:56.339213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.352552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.355732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.374754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f05d6-84a3-429f-bfa0-6d2e786948a8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:56.378912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:56.380858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:56.382473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:56.384227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:56.388632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 277/565] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:56.395855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.444112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:56.445080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:56.445530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:56.445987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.447064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:56.447557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.449887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.472178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 289/566] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:56.478634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.568175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:56.659416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744620-bb71-471f-b8a1-f60931b24e13 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:56.693801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6ea3-e2bb-403b-a698-c50a67bb4b5f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:56.730701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:56.732336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:56.733250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:56.733970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.735865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:56.736616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.739461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.763887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:56.763887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:56.763887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:56.764527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:56.780268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:56.782689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 278/567] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:56.783010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:56.789322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:35:56.806587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:56.808472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:56.809926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 290/568] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:56.817514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:56.916429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:57.178973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14c25f-3a40-4bbb-841d-700f31ff5960 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:57.182940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8c57-66bf-4419-98b4-be905aa9eb17 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:57.204179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:57.247317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:57.248043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.248227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.248511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.249366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:57.249665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:57.251134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:57.255952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:57.256585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.256847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.257119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.257853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=b10284800d0248778a9b4ece037e3343) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:57.258160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:57.259623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:57.278409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 279/569] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/role_assignments?user.id=b10284800d0248778a9b4ece037e3343&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:57.283043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 291/570] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:35:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:57.293031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:57.459324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cdc7b-bd9f-4feb-ab35-6974c5b9b0fa None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:57.505554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:57.506205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.506472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.506738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.520183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:57.521669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-62f91af7-d4a9-4da0-9bc4-b5f1c1e3fd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:35:57.538924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:57.540832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:35:57.543139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:35:57.543139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:35:57.543139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:57.543139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 280/571] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:57.549879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:57.721012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:57.765985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf81e4-5731-498c-8ada-1139640414ec None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:57.832520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:57.833379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b31f-a371-4f27-b0d0-afd083b76b95 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.833490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.833964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.834192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b31f-a371-4f27-b0d0-afd083b76b95 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.834408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.834851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b31f-a371-4f27-b0d0-afd083b76b95 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.835531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:57.836083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:57.837310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 281/572] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:57.838606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:57.846074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:57.846721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:57.847188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:57.862779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 292/573] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:57.881416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:57.881613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:57.883084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:57.920211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:57.978478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 282/574] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:35:58.182232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f2b6-5a37-4f78-a02c-0439f2bb6269 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:58.258561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:58.259512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.259512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.259773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.267913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:58.269405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:35:58.287045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:58.288742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:58.290365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 293/575] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:58.295816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:58.408583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5d8b-cc94-4c4e-86bb-4356e8062b29 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:58.449242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:58.449892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.450167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.450777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.451504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:58.451937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:58.453502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:58.471950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 283/576] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:58.474681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:58.480364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:58.577793 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:58.597017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bf58b-d8ba-434f-a522-7a38d95c5b05 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:58.636138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:58.636961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.637275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.637514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/ecc00888b1344a4fbc4fb5fd383791ee/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.640134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=ecc00888b1344a4fbc4fb5fd383791ee, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:58.641689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86592-6b70-4229-bab8-b55d5985bca3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:58.650749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:58.675341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 294/577] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:35:58 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/ecc00888b1344a4fbc4fb5fd383791ee/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:35:58.699495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083639ae-1b08-4588-916c-708655a37320 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.699975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083639ae-1b08-4588-916c-708655a37320 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.700867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083639ae-1b08-4588-916c-708655a37320 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.704383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 295/578] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:35:58.714129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.714129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.714502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.782220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:58.783585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:35:58.806826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3851bd7-72b9-4d03-968e-2afe6fa6056f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:58.859113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:58.859806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:58.860101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:58.860376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:58.860983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:58.862958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:58.873395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:58.874531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:35:58.875420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 284/579] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Oct 15 13:35:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:35:58.886111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:58.988401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:59.002040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:59.019896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956682e0-2e4c-4536-bf75-72bb1ff58f40 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:59.028585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 296/580] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:35:59.064704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:59.065371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.065714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.065989 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.066750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:59.067063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:59.068573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:59.076136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 285/581] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:35:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:59.083040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:59.233020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcfd1e-9020-4ba0-862f-6e7997ac0d0c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:59.272576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:59.274087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.274583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.275059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.275931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:59.276461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:59.278090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:59.284553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 297/582] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:35:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:59.292957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:59.466666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209761d-0025-47f8-9d4a-66e076c4b526 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:59.498554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:59.559474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:59.560589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.561109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.561567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.563477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] RBAC: Adding query filter params (interface=public, service_id=1597c96099cf44f2ac2cc2003ec1bcc1, region_id=RegionOne) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:35:59.564109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:59.571427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:59.603519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 286/583] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:35:59 2022] GET /identity/v3/endpoints?service_id=1597c96099cf44f2ac2cc2003ec1bcc1&interface=public®ion_id=RegionOne => generated 194 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:35:59.620405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:59.647143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:59.705837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:35:59.785804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f146b-372b-4fd9-ad5b-14f134fae715 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:59.822538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43538-d571-4764-ac9e-3f6360c0a56b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:35:59.851297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:59.852928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.853746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.854924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.869426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:35:59.870057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.870341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.870594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.871195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:35:59.872641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517a01-14de-41dd-974c-83dbfed1db1c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:35:59.879869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 287/584] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:35:59 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:35:59.880981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:35:59.881244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667de0f0-e155-45e1-8a78-c1e977f0b6b1 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.881534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667de0f0-e155-45e1-8a78-c1e977f0b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.881896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667de0f0-e155-45e1-8a78-c1e977f0b6b1 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.888123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 288/585] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:35:59.890138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:35:59.890454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:35:59.890720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:35:59.893229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:35:59.895138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:35:59.896970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:35:59.910242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 298/586] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:35:59.915510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:35:59.916068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:35:59.917283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:00.011387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:00.020067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 289/587] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:35:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:00.082700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969918c-d3e9-4de7-8961-6ed7bc08d07e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:00.102457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:00.123337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:00.124304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.124587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.124942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.125647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:00.125949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:00.127522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:00.137506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 299/588] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:00.146308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:00.307780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8e60-b258-44f8-9949-86fe382a5f58 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:00.365837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:00.367314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.367931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.368432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.388165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:00.391275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:00.409006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:00.428171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:00.429867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:00.431528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:00.431528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:00.431528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:00.437045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 290/589] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:00.445624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:00.567090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e1b6-ce6e-49e8-8ee3-c557fc56f3f6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:00.568382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:00.612557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:00.613229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.613506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.613776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] PATH_INFO: `/v3/services/network` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.614380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:00.615772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:00.635519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:00.636626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:00.637485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:00.646921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 300/590] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:00.649259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:00.708958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:00.721904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65ed3-29fd-44c3-9bac-ccdb5249fd24 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:00.780686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42645-8523-42ae-b636-b37d410cfeba None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:00.805921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:00.806916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.807423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.807967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.808829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:00.809352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:00.811980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fae92-d8ca-452b-9ed3-21376c621a1a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:00.826337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:00.827506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.827506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.827691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.828290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] RBAC: Adding query filter params (name=network) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:00.828589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:00.829984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc45d3-5c7d-407d-8b0e-32667d353e6a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:00.836929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 291/591] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:00.838586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0323f-9b63-48d2-b5c7-ec0fcb506000 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.838870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0323f-9b63-48d2-b5c7-ec0fcb506000 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.839144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0323f-9b63-48d2-b5c7-ec0fcb506000 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.840536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 292/592] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:00.847102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 301/593] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:00.848234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0323f-9b63-48d2-b5c7-ec0fcb506000 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:00.849914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:00.850443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:00.851005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:00.879691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:00.880958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:00.984032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 302/594] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:00.985927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.005573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0323f-9b63-48d2-b5c7-ec0fcb506000 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.034486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.059478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.079722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.080414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.080691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.080961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.096785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:01.098342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:01.124332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:01.125388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:01.126334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 293/595] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:01.135915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.195274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce92c51-464e-4705-9b81-d7a6eeff6f37 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.255677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.256296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.256757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.257130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.258225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:01.258748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:01.260711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fe42-c080-4c2b-8d01-cad43cfba9c9 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:01.271853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 303/596] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:01.271853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008572-9bad-4757-8193-da543255d1f0 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.271853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008572-9bad-4757-8193-da543255d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.271853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008572-9bad-4757-8193-da543255d1f0 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.279578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 304/597] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:01.281722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.282171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.282610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.307688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:01.309173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:01.342705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cd8b-43ac-460a-9d5a-e4e64e58ac4e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.413858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.414659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.414940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.415212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.416028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:01.416336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:01.417893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:01.443259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 305/598] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:01.445967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.449675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 294/599] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Oct 15 13:36:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:01.451134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.496608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.513723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.611086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737fad-bef3-4169-af6c-4f00c7b4116d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.656063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0946-c4ef-40bc-aca7-95c1845539c3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.677842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.678837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.679290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.680266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.681078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:01.683673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:01.701102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:01.703160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:01.704498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 295/600] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Oct 15 13:36:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:01.706157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.737813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.739171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.740047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.740715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.742243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] RBAC: Adding query filter params (interface=public, service_id=a7b7161175df48ea8225c844410396b9, region_id=RegionOne) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:01.743135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:01.746136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:01.769949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 306/601] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:01 2022] GET /identity/v3/endpoints?service_id=a7b7161175df48ea8225c844410396b9&interface=public®ion_id=RegionOne => generated 194 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:01.772226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:01.887569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.896491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678342-9c44-4024-8deb-3f03fc54b58e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.941493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:01.941759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.942559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.943037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.943591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.950850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5ebe-e350-4fc5-b5d3-51ca50261853 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:01.995191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:01.996177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:01.996693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:01.997209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:01.998034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:01.998545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.000347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.006888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 307/602] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:02.008324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.076293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.078388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.188745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa0323-c2a1-40ba-b4a2-c499b85579cc None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:02.216635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:02.235850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 296/603] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:36:02.235850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.257705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:02.258540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:02.259082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:02.259528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:02.260608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.262920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.271685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 308/604] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:02.272979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.323003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:02.430510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cce02d-d866-4d0b-9e49-9ed283eb2f4a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:02.475070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9b890-34a4-4d56-9337-a28d1833f036 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:02.494096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:02.495210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:02.495744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:02.496316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:02.516643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:02.523846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:02.525719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:02.527287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:02.532415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 297/605] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:02.534092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.566865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:02.568988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:02.570121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:02.570862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:02.572309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:02.573327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.577724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.589663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 309/606] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:02.591762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.652123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:02.760531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a39-58a7-453c-a0ca-779d365ff373 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:02.800129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:02.834822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:02.835936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:02.836433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:02.836858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:02.837384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663789-7ae5-4305-9a9f-5e37afe758ce None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:02.859593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.862846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:02.896295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:02.898405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:02.900366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:02.900366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:02.900366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:02.900366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 298/607] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:02.908995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:02.921902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:02.922564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:02.922841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:02.923108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:02.923823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:02.924127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:02.925554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:02.955267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 310/608] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:02.962729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:03.126164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253a97-00fc-4a25-a075-7a54a4bda14f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:03.141352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:03.176149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724038-70c6-4619-8377-ed3648e95133 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:03.194873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:03.196385 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.197123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.197891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.199410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:03.200601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:03.204046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37839c48-74fd-4900-a6da-779e19fef4a1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:03.226637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 299/609] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:03.229500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe21b-665a-4675-a759-ee50116746dd None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.230352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe21b-665a-4675-a759-ee50116746dd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.231139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe21b-665a-4675-a759-ee50116746dd None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.233940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 300/610] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:03.238710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfe21b-665a-4675-a759-ee50116746dd None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:03.250987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:03.252161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.252697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.253220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.276625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:03.279279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:03.296799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-5187ead1-87c7-47e0-82b0-3ac9ff667da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:03.311240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:03.313375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:03.315387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:03.315387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:03.315387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:03.320749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 311/611] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:03.323005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.323461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.323947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.353764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:03.356635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:03.443965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 312/612] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:03.444867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:03.445129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfe21b-665a-4675-a759-ee50116746dd None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:03.514434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:03.516026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.516822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.517595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.530160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:03.533694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:03.558904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8c2b-f921-4310-ad99-b44fd60ca3e2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:03.560463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:03.562358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:03.564322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:03.568021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 301/613] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:03.574531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:03.605483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:03.617376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:03.618877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.619599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.620339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.621664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:03.622414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:03.625481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:03.648321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 313/614] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:03.669561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:03.684382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:03.836564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056b506-1917-423a-a953-697ae3058b66 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:03.913264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:03.914509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:03.915384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:03.916063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:03.918002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:03.918525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:03.921297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:03.947662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 302/615] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:03.959875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:04.096817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d833-6173-4209-9da0-4cf440f9358f None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:04.167256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:04.168119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:04.168612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:04.169248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:04.185567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:04.188969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:04.192495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:04.217934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:04.219764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 15 13:36:04.222090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:04.223125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720e5d1-0d08-431a-adcb-97a513d757b1 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:04.226999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 314/616] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:36:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 558 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:04.228968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:04.285834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:04.287403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:04.288140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:04.288888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:04.290605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=560f0a24a22f40048578a6e9ffb36927) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:04.291466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:04.294564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:04.316261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 303/617] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:03 2022] GET /identity/v3/role_assignments?user.id=560f0a24a22f40048578a6e9ffb36927&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:04.318372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:04.350141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:04.468801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86fd26-d0e7-4348-9d32-0b439d6f2441 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:04.544998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:04.546464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:04.547180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:04.547968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:04.549521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:04.552653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:04.570460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:04.572974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 13:36:04.576081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:04.580688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 315/618] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Oct 15 13:36:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:04.590848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:04.636579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3321c7-555d-4264-89dd-3388c34486bf None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:04.734170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:04.736810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:04.737507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:04.738178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:04.739762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:04.740942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:04.745441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:04.789456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 304/619] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Oct 15 13:36:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:04.802379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:04.832255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:04.900182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7a30-e943-43e2-b727-ba9df7c96d3a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:04.934214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:04.995844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:04.997220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.000875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.001956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.003369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:05.005843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:05.009140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:05.031750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 316/620] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:36:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:05.042166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:05.091429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bf36-0b8b-489f-9e6e-9f18899d781d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:05.221211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:05.221896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.222175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.222459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.292437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe349-e0b7-420b-a9ac-f720e5208e4e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:05.378654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:05.379753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.380223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.380701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.381815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:05.382336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:05.384811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:05.392259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:05.395485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219943-f8ec-4af0-824e-805783a0edc2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:05.408489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 317/621] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Oct 15 13:36:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:05.410029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:05.424365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:05.494110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:05.621351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1560ec-4b67-42f7-b8cf-9b5cc819d449 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:05.622364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 305/622] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 15 13:36:05.624287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7f48-7bcf-4e72-994a-9b530457839e None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.624903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7f48-7bcf-4e72-994a-9b530457839e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.625306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7f48-7bcf-4e72-994a-9b530457839e None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.631127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 306/623] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:05.632257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c7f48-7bcf-4e72-994a-9b530457839e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:05.693985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:05.695222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.695863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.696447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.697693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:05.702040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071275d-e45c-439c-9ad4-c715ad8c3530 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:05.752285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 318/624] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:05.755518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.756188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.756884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.797655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:05.800143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c7f48-7bcf-4e72-994a-9b530457839e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:05.804827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:05.805713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:05.884589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:05.885657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:05.886392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:05.887326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:05.912162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:05.915827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:05.946597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:05.947645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:05.948594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:05.948594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:05.948594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:05.951722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 307/625] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:05.957839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:05.975465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 319/626] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:06.113080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49120a-834d-4e70-956e-e56105ab510a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:06.159043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:06.160456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.161172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.161837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.163238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:06.164017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:06.166804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124917-bbe1-437f-9f0b-1a7a0c5739ea None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:06.192948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 308/627] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:06.199127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:06.250600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d674f4-1e41-45a0-9c7b-8c3e606c9d30 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.250930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d674f4-1e41-45a0-9c7b-8c3e606c9d30 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.251150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d674f4-1e41-45a0-9c7b-8c3e606c9d30 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.252823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 309/628] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:06.256370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:06.258757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.259277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.259740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.285071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:06.286841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:06.301279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:06.382760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78810-ff2a-46b2-bad6-651c3f99deb3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:06.430304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 310/629] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:06.456031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:06.457074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.457488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.457893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.476069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:06.479001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:06.511218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:06.513106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:06.515149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:06.518925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 320/630] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:06.529045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:06.569656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:06.776723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:06.778397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab31a7f-c9d8-4627-b156-2e27e0a0a7ea None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:06.812237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb48c7-a6a4-480b-a3bb-f67f4c7414ac None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:06.887619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:06.889625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.890143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.890635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.891577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:06.892155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:06.893977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:06.900663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:06.901683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:06.902166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:06.902649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:06.903745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:06.906320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:06.909866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 311/631] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:06.911162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:06.922261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:06.935116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 321/632] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:06 2022] POST /identity/v3/services => generated 269 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:06.940753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:07.125014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386d8-01ea-4f92-acb1-528a4a57b3ac None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:07.223374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd907f-f1ea-468a-90f4-3718d4ff524c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:07.227316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:07.230398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.230398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.230398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] PATH_INFO: `/v3/services/network` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.230903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:07.233389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:07.253820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:07.254909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 13:36:07.255774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:07.256552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 312/633] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:06 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:07.265228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:07.278632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:07.279267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.279851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.280271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.281651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=ecc00888b1344a4fbc4fb5fd383791ee) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:07.282047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:07.283533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:07.291576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 322/634] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:06 2022] GET /identity/v3/role_assignments?user.id=ecc00888b1344a4fbc4fb5fd383791ee&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:07.358926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:07.405314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba0d2-47e7-4879-b35c-73a74c62ca6d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:07.447553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:07.448241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.448525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.448798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.449481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] RBAC: Adding query filter params (name=network) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:07.449777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:07.451589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:07.460428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 313/635] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:07.464045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:07.491594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:07.607485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0da87-b6ad-456e-805c-128baae04d77 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:07.649756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:07.650389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.650664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.650929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.651649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:07.651995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:07.653402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9543-288a-4920-98fc-49028652b2f1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:07.659742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 323/636] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:07.665269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:07.830713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02906-edbd-494e-bc51-e188546db280 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:07.871343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:07.879717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:07.884651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.884962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.885370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.886268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:07.887915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76557b8-fe9a-4157-b73e-4e8f7417b935 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:07.923849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 314/637] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:07.972545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c60f8-7f82-49b7-a85c-67ada69d2551 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.973075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c60f8-7f82-49b7-a85c-67ada69d2551 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.973075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c60f8-7f82-49b7-a85c-67ada69d2551 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:07.974773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 324/638] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:07.980924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:07.981231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:07.981477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:08.002397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:08.003660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:08.110106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 315/639] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:07 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:08.455521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c60f8-7f82-49b7-a85c-67ada69d2551 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:08.562302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:08.609095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c60f8-7f82-49b7-a85c-67ada69d2551 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:08.655910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:08.656629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:08.656902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:08.657170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:08.674584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:08.679429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:08.680766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:08.681630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 325/640] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:36:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:08.689237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:08.818325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa181-353e-40c4-8d2f-5236e9677c33 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:08.836422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:08.863969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:08.865026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:08.865309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:08.865585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:08.866264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:08.866570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:08.868096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407af988-21d2-4130-a63e-fba48c315aed None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:08.877910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 316/641] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Oct 15 13:36:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:08.884621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:08.954382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8a70-6d3e-4700-98a3-a1828e49e701 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:08.954950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8a70-6d3e-4700-98a3-a1828e49e701 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:08.955036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8a70-6d3e-4700-98a3-a1828e49e701 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:08.956862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 317/642] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:08.965448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:08.965825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:08.966284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:08.994878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:08.996741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:09.023449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ebcc-ba15-48e5-a7c7-ce90a450ce29 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.064214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:09.071024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.072632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.072632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.072854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.101716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.104831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.107151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 318/643] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:09.128561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:09.130127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:09.133258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:09.133258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:09.133258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:09.133258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 326/644] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:09.140764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.308457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c79472-3d51-4a00-b03d-f6569271253a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.311300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:09.349438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.350078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.350429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.350703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.351370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:09.351936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.353110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.366917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 319/645] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:09.373202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.421583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.543387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64a285-1125-4e49-ab80-a185fb0a3330 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.590850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a8d0-c968-4f81-a9eb-cb8fab8982b9 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.602575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.603643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.604192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.604677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.615191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.617262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:09.631566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:09.632732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:09.633714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:09.641813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 327/646] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:09.643478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.644859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.645546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.645817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.646087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.646710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.648519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:09.659748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:09.661559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:09.662714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 320/647] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:09.668098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.707837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:09.732944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:09.820555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada19d-189f-47a4-a9ef-5d8869afab21 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.835938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec039-9ad6-4ada-8f55-8ac245b75fbf None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:09.872872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.873656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.873943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.874221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.875069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:09.875865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.877433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.902881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 328/648] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:09.909847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:09.911277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:09.912024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:09.912754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:09.913072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:09.914381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:09.915099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:09.918454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:09.929014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 321/649] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:09.939867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.068547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28e97-b866-4b21-a030-0501c6ee5a25 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.071283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:10.074592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:10.083146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ac42-bfb5-46e9-9aa9-8f3e9b64b55d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.125074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.126118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.126640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.127112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.127924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:10.128335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.129898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566fe5b-ea99-4473-9a50-dbe2b2a34d7a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:10.132380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.133048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.133316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.134000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.143818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 322/650] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:10.143818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dba2f-e3ed-47c5-881f-5e358832d119 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.143818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dba2f-e3ed-47c5-881f-5e358832d119 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.143818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dba2f-e3ed-47c5-881f-5e358832d119 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.143818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 323/651] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:10.147032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c0d0-a86d-4cb2-abc7-24f30f6df46a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.147365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c0d0-a86d-4cb2-abc7-24f30f6df46a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.147575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c0d0-a86d-4cb2-abc7-24f30f6df46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.162211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.165507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:10.174863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2cc7c0d0-a86d-4cb2-abc7-24f30f6df46a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:10.176232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2cc7c0d0-a86d-4cb2-abc7-24f30f6df46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:10.196581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:10.197627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:10.198635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:10.198635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:10.198635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:10.198635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 329/652] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:10.205695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.304659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 324/653] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:10.359751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7d13-b434-4766-b534-1899f751abaf None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.363769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6748-e21a-4e6f-a670-9ee93c8af8b4 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.364106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6748-e21a-4e6f-a670-9ee93c8af8b4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.364385 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6748-e21a-4e6f-a670-9ee93c8af8b4 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.366981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 325/654] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:10.373899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de219-b282-4038-a989-3b6b2901e310 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.374225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de219-b282-4038-a989-3b6b2901e310 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.374456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825de219-b282-4038-a989-3b6b2901e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.397358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-825de219-b282-4038-a989-3b6b2901e310 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:10.398532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-825de219-b282-4038-a989-3b6b2901e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:10.429262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.431282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.431807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.432718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.434978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:10.436008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.438689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:10.472423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 330/655] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:10.477668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.482235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 326/656] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:10.516203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:10.673516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825de219-b282-4038-a989-3b6b2901e310 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.674385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8eed4-c619-453e-b3c8-efc0ff68c8af None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.716388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:10.727837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.727837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.727837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.727837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.732125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.734349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:10.749178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:10.750168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:10.751096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:10.755398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 331/657] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:10.756736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.869854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825de219-b282-4038-a989-3b6b2901e310 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.897603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:10.926872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.927724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.928214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.928657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.929620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.931955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:10.946885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00695c0-031c-4be4-8ee4-b09be42defab None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:10.947962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:10.950073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:10.957894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 327/658] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Oct 15 13:36:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:10.959417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:10.994032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:10.994677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:10.995040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:10.995214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:10.995992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:10.996497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:10.997869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.012080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 332/659] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:11.012679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.086867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:11.111609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf2a7-f619-40e9-9f1b-4339ed2b7ef6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.150095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.150748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.151026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.151294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.151922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.153325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:11.163360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:11.165233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:11.166599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:11.167347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb545-03b2-47ca-8084-843e6f84a5ac None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.167754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 328/660] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:11.167754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.210038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.210587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.210864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.211138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.211876 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:11.212182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.213578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.215004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:11.220050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 333/661] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:11.225583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.303838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45623-5ff9-424c-aaea-695ff4649995 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.344553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.345242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.345522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.345795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/560f0a24a22f40048578a6e9ffb36927/roles/38b3e00dd4ec430487475150b217f921` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.348145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=560f0a24a22f40048578a6e9ffb36927, role_id=38b3e00dd4ec430487475150b217f921)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.349629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.370662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 329/662] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:36:11 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/560f0a24a22f40048578a6e9ffb36927/roles/38b3e00dd4ec430487475150b217f921 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:36:11.372382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.380509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:11.403745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89697987-ce87-43df-9d6e-caa5fea3ba77 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.457750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.459431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.459946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.460448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.461990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:11.462497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.464461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.476637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 334/663] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:11.484898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.557739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55deb3-773b-48a0-afa3-bd00b651c43f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.608694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:11.614344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.614986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.615252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.615521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.616226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:11.616534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.617956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.628653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 330/664] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:11.633632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:11.692443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e384-2f02-4ad7-8c31-5fbbc35bcbce None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.738771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.739806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.740281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.740705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.741501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:11.741955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.743570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.751313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 335/665] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:11.808145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:11.879436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9378-3672-4088-ae18-8781e8d2ff9a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:11.952861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c441f-d326-4542-9255-572edd893021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:11.953932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c441f-d326-4542-9255-572edd893021 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:11.954419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c441f-d326-4542-9255-572edd893021 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:11.954901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c441f-d326-4542-9255-572edd893021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:11.956310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c441f-d326-4542-9255-572edd893021 None admin] RBAC: Adding query filter params (interface=public, service_id=0c8b17c544c549eb994c9a24d096fdab, region_id=RegionOne) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:11.956879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c441f-d326-4542-9255-572edd893021 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:11.959540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c441f-d326-4542-9255-572edd893021 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:11.970494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 331/666] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/endpoints?service_id=0c8b17c544c549eb994c9a24d096fdab&interface=public®ion_id=RegionOne => generated 194 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:11.976407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:12.137968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3b60-a288-4829-89e2-2dcbeb260f65 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:12.190757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:12.206687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:12.207611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:12.208058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:12.208458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:12.209403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:12.211656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc587-bd06-41ff-8ad7-dbde39d1d5bb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:12.223292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 336/667] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:11 2022] GET /identity/v3/services => generated 1029 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:36:13.798335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d4a8-b2cd-420c-b26e-e5439dd4e98d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:13.799123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d4a8-b2cd-420c-b26e-e5439dd4e98d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:13.799277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d4a8-b2cd-420c-b26e-e5439dd4e98d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:13.802146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 332/668] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:13.812378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4dfed-3463-4222-981e-09003485b032 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:13.813178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4dfed-3463-4222-981e-09003485b032 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:13.813311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4dfed-3463-4222-981e-09003485b032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:13.845289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-68a4dfed-3463-4222-981e-09003485b032 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:13.847384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-68a4dfed-3463-4222-981e-09003485b032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:13.983026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 337/669] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:14.108138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f197f-766d-48f0-8049-b4305251e4d4 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.108460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f197f-766d-48f0-8049-b4305251e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.108778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f197f-766d-48f0-8049-b4305251e4d4 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.110513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 333/670] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:14.116456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.116722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.117028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.139587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:14.140831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:14.229052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 338/671] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:14.505160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f197f-766d-48f0-8049-b4305251e4d4 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:14.517463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:14.581242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:14.646095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f197f-766d-48f0-8049-b4305251e4d4 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:14.650451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1ed8c-61ed-4dd8-b02f-6aec9cbe1073 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:14.698693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:14.713888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:14.714905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.715311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.716644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:14.717729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.718222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.718684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.719903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:14.720010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.721051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:14.722317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a06db2-0706-434f-aaea-179492873396 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:14.723336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a743a-0948-4bcc-8a4b-31997d0e6536 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:14.745002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 339/672] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:14 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:14.746728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3da0d-6e5d-4765-a329-727da95268d6 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.747255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3da0d-6e5d-4765-a329-727da95268d6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.748243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3da0d-6e5d-4765-a329-727da95268d6 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.750335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 340/673] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:14.755116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 334/674] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:14 2022] POST /identity/v3/services => generated 241 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:14.764454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.764730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.765025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.788418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:14.789964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:14.887838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448b699-1f65-4741-bee0-9120dd3204fa None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.888696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448b699-1f65-4741-bee0-9120dd3204fa None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.888867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448b699-1f65-4741-bee0-9120dd3204fa None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.895840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 335/675] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:14.901554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:14.902481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:14.903218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:14.910192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 341/676] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:14.937819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:14.940339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:15.082830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 336/677] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:15.411315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:15.483290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:15.570491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3d013-910e-4ed0-b36a-77fc32635dbc None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:15.577515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:15.625344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:15.627214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:15.628200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:15.628470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:15.629554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:15.631408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:15.643650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:15.644821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 13:36:15.645869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:15.653350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 342/678] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Oct 15 13:36:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:15.656931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:15.762266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e08a-1da0-4a14-b6d3-617153d835f2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:15.819369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:15.846826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:15.847970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:15.848458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:15.848939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:15.869953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:15.878464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:15.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:15.893551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:15.895506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 337/679] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:36:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:15.898600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1550-c441-4de8-8cb8-6e6c1c8eb7f8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:15.898841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:15.974734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:15.977103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:15.977771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:15.979113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:15.981140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:15.982095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:15.985740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.004474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 343/680] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:16.008704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:16.074665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69475782-5049-46d5-8862-2be13bf26dad None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.121970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.123111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.123607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.124113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.125076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:16.125696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.127441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.143277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 338/681] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Oct 15 13:36:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:16.144578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:16.199984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:16.230369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cabf-4ce3-4209-80ec-a1a5efc7bdeb None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.272507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.273432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.273857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.274274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.275414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:16.275918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.278047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.284953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 344/682] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:16.295412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:16.298058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b792ea-a4e2-4e01-a6ed-d91950c52513 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.334933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:16.365052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.366117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.366597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.367071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.387060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.389982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:16.420095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:16.421935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:16.423684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:16.423684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:16.423684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:16.428423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 339/683] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:16.432084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:16.468636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2941fe-fe2f-4a3c-9435-19da83c17d2e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.513570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.514737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.515233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.515723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.516688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.518341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.560046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 345/684] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:16.607885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:16.617537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106fc55-72a3-4101-ac1a-daa8bcab2608 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.670666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.671705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.672243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.672736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.673621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:16.674153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.675872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.694887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 340/685] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:16.702808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:16.808785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:16.832915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bb0d7-a2a8-4646-943c-6e7231609517 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:16.886911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:16.887577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:16.887899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:16.888259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:16.899825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:16.901435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:16.916300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:16.918088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:16.919988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 346/686] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:36:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:16.924621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:17.070386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4788-8455-486d-83ae-c2ea1f75c60e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:17.136272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:17.137889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.138729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.139539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.141237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:17.142071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:17.145075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c1e9e-3bbb-4f3c-bae9-306f1de56c70 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:17.181653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 341/687] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Oct 15 13:36:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:17.191868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:17.308716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7f20-e15d-4248-b14c-3f28e6e08fca None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.309055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7f20-e15d-4248-b14c-3f28e6e08fca None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.309278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7f20-e15d-4248-b14c-3f28e6e08fca None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.311125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 342/688] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:17.316857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7363-78de-46f0-a25c-aea8d555f578 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.317171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7363-78de-46f0-a25c-aea8d555f578 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.317414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7363-78de-46f0-a25c-aea8d555f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.340584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ae0a7363-78de-46f0-a25c-aea8d555f578 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:17.342078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ae0a7363-78de-46f0-a25c-aea8d555f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:17.347145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:17.402974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a13dd4-06ca-44ff-bbf7-f3e775d5215e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:17.428512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 343/689] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:17.429944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f589-ad2d-4ad6-9d04-3782c2815e47 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.430229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f589-ad2d-4ad6-9d04-3782c2815e47 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.430501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f589-ad2d-4ad6-9d04-3782c2815e47 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.432079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 344/690] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:17.438329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.438725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.438904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.459975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:17.460784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:17.468409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:17.470018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.470540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.470959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.502510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:17.548324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 345/691] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:17.613902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:17.616680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:17.723038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:17.802691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 347/692] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 15 13:36:17.808401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:17.822191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:17.860701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bdf9f-fa45-4be5-b82d-ca4c94447c67 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:17.895678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:17.901372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:17.902126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:17.902412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:17.902686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:17.903299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:17.905423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:17.915704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:17.918272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:17.920245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 346/693] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:17.923366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:17.980221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94435-30a3-467a-857d-0319a842d216 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.020975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.021622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.021872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.022255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.035336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.036892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:18.054157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:18.055319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:18.056324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:18.056324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:18.056324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:18.060467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 348/694] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:18.061361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.083115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d040-4dd8-4c7d-aa9e-3ca7bbde287b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.138798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.140552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.141278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.142003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.143321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.146262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.151556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:18.164961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:18.167101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:18.168960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:18.172929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 347/695] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:18.174831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.188084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.201051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1b29-b3c5-4a92-a2d3-00752be43af1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.250067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.250901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.251310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.251719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.252571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:18.253594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.255121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.262524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 349/696] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:18.264010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.316536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644ecf-3142-45f3-ae59-d0e9676e10ab None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.369134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.370005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.370416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.370831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.371662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:18.372139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.374127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.390572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 348/697] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:18.391638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.413492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421de9-2da5-4b6b-9936-cb117dc3a350 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.465181 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.466129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.466579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.467122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.468035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:18.468496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.470073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.479720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 350/698] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:18.482159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.492581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.531916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.560954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e6b8-1445-4a16-b3dc-4a3b461ba810 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.620670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.621664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.622176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.622683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.623939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:18.624394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.626814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.638472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63429-bce4-4f5b-b085-8f986a96260a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.643993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 349/699] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:18.645638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.701453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.702513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.703182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.703662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.722976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.726618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:18.749282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:18.750296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:18.751322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:18.752864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 351/700] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:18.752864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.795596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fbf5-e668-4703-a31b-6feb01a5a7e7 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:18.825348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.840817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:18.842559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:18.842958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:18.843345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:18.844171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:18.844653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:18.846334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:18.859754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 350/701] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:18.859754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:18.930376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:18.953899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfbda-17aa-4320-89f2-aeadd98e8326 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.003820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.004938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.005420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.006611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.008020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] RBAC: Adding query filter params (interface=public, service_id=b4aa81fa97e14748bd5aaf0b14769632, region_id=RegionOne) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:19.008579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.011964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.020182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5548bd-cc11-41bc-a44b-f5f611c60f33 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.027301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 352/702] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/endpoints?service_id=b4aa81fa97e14748bd5aaf0b14769632&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:19.027301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:19.073341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.074077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.074771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.075120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.076507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:19.077068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.078837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.101009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 351/703] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:19.101009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:19.151018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1b94-6337-4345-bea1-5ec5b183d779 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.154725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:19.196523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.197449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.197813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.198165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.198961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] RBAC: Adding query filter params (interface=public, service_id=14ed1dc236b7469aae04a77f6bd0e046, region_id=RegionOne) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:19.199700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.201563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a85283-b825-493b-a091-0ecf74b7878d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.207993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 353/704] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:19 2022] GET /identity/v3/endpoints?service_id=14ed1dc236b7469aae04a77f6bd0e046&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:19.209973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d43eb-8d0d-421b-bdf0-7089dce3f5c2 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.210356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d43eb-8d0d-421b-bdf0-7089dce3f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.210739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d43eb-8d0d-421b-bdf0-7089dce3f5c2 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.212626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 354/705] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:19.213396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d43eb-8d0d-421b-bdf0-7089dce3f5c2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:19.233791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868756-11de-4ec8-a7e9-4b1e1aed8877 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.235506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:19.274786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.275600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.276005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.276384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.277181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.278776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.285499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 352/706] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:19 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:36:19.286356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:19.373390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d43eb-8d0d-421b-bdf0-7089dce3f5c2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.428689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716df7b-7ea9-4d75-839a-a43bedfc3814 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:19.437354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.438260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.438683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.439107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.440394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] RBAC: Adding query filter params (role.id=38b3e00dd4ec430487475150b217f921, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=560f0a24a22f40048578a6e9ffb36927) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:19.440886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.443832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91143ef-114c-4e8c-8bf9-496ff72d5522 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.443988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:19.464123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 355/707] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:19 2022] GET /identity/v3/role_assignments?user.id=560f0a24a22f40048578a6e9ffb36927&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=38b3e00dd4ec430487475150b217f921 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:19.465551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.465837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.466182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.487676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:19.488981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:19.510050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:19.510685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:19.510958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:19.511224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:19.511909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:19.513493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:19.520769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 353/708] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:19 2022] GET /identity/v3/services => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:36:19.628967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 356/709] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:20.113958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:20.236235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945003d-1b81-46ba-a1cc-d956317de0fa None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:20.274907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:20.275564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:20.275865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:20.276135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:20.276716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:20.278117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:20.287887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:20.288940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:20.289775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 354/710] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:20.298579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:20.313558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:20.417162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f48ec5-0cd9-47d6-b4f5-a477e341bcfe None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:20.457461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:20.458088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:20.458353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:20.458682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:20.459320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:20.459664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:20.461079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f4c1d-fb8f-4071-8fea-edc369c437ba None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:20.467073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 357/711] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:20.475969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:20.542696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:20.643376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86dd5f-d40f-46c9-b0fe-fdc9991e363a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:20.683898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801994-e394-407a-82cb-3df5508e232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:20.684534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801994-e394-407a-82cb-3df5508e232d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:20.684876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801994-e394-407a-82cb-3df5508e232d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:20.685155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801994-e394-407a-82cb-3df5508e232d None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:20.685801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02801994-e394-407a-82cb-3df5508e232d None admin] RBAC: Adding query filter params (type=compute) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:20.686102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02801994-e394-407a-82cb-3df5508e232d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:20.687513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02801994-e394-407a-82cb-3df5508e232d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:20.693335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 355/712] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:21.798637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1374-f7bd-404c-82ca-b1b23765837d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:21.799167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1374-f7bd-404c-82ca-b1b23765837d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:21.799167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1374-f7bd-404c-82ca-b1b23765837d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:21.800936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 358/713] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:21.806740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067609ff-bca7-4d32-a7a6-62deda4c7bd2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:21.807268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067609ff-bca7-4d32-a7a6-62deda4c7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:21.807268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067609ff-bca7-4d32-a7a6-62deda4c7bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:21.831843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-067609ff-bca7-4d32-a7a6-62deda4c7bd2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:21.833160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-067609ff-bca7-4d32-a7a6-62deda4c7bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:21.916005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 356/714] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:22.100778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf2b7-3654-4f11-87aa-20f306910b25 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.100778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf2b7-3654-4f11-87aa-20f306910b25 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.100778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf2b7-3654-4f11-87aa-20f306910b25 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.102370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 359/715] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:22.108488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.108874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.109140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.130401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:22.131635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:22.163430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:22.206449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf2b7-3654-4f11-87aa-20f306910b25 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.219576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 357/716] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:22.286836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:22.321632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf2b7-3654-4f11-87aa-20f306910b25 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.360570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.361143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.361419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.361688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.362290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.363703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:22.373460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:22.374577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.375429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 360/717] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:22.383034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.501349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e17349-1d9a-4c3e-b22f-4d9cedb049cc None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.521074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.539476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.540141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.540418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.540684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.541320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:22.541619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.543128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.551831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 358/718] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:22.554693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.588882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:22.655659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d9864-c86d-4f74-bfc8-1a22052baa32 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.676358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b642d-4ecd-4c46-b863-c19a2fbe58a4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.704283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.705538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.705968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.706667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.707965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.710507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.713819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:22.716556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.717448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.717938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.718441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.719305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:22.719686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.721209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:22.725964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:22.726974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:22.727832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:22.734265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 361/719] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:22.736812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 359/720] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:22.737569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.743667 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.866061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:22.866694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fed69-55ad-43b1-ab52-3f3b71286808 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.879911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08412f-94eb-4832-82b6-105ee0261251 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:22.905911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.906454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.906730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.906999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.907739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:22.908072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.909565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.915436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 362/721] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:22.921838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:22.924619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:22.925482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:22.925973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:22.926529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:22.927267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:22.928766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:22.967843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 360/722] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:36:23.021745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:23.081280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef506a-9601-4815-9762-7a10484fdc86 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:23.135317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:23.136059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.136333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.136602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.137332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:23.137637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:23.139394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf876da-f366-42bb-8526-461e99a1c7a6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:23.147562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 363/723] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:23.153820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:23.184478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce6a9-3afe-4dd7-8c6d-fddbc04d1ec1 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.186028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce6a9-3afe-4dd7-8c6d-fddbc04d1ec1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.186316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce6a9-3afe-4dd7-8c6d-fddbc04d1ec1 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.188055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 364/724] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:23.195370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.195711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.195968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.218910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:23.220296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:23.298189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ceff-f2db-4940-8dca-4daafb04c387 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:23.313250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 365/725] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:23.354461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:23.355384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.355980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.356457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.357712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:23.359387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bb21d-cb7f-4705-bc05-08c2ce34c08f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:23.383968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 361/726] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:36:23.607195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:23.650457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379ba83-512f-4ae6-88d8-82d385cc4c62 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.650457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379ba83-512f-4ae6-88d8-82d385cc4c62 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.650805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379ba83-512f-4ae6-88d8-82d385cc4c62 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.653648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 362/727] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:23.663024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.663486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.663984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.677009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:23.698384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:23.700481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:23.702713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:23.739857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2af2-11f5-40fb-888c-4b1a23fb9042 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:23.792497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:23.793710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.794201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.794835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] PATH_INFO: `/v3/services/image` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.795819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:23.797394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:23.808294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:23.809701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:23.811248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:23.819511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 366/728] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Oct 15 13:36:23 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:23.821301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:23.851974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 363/729] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:23.939593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67262a-117a-441c-867e-913ebc80fbe4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:23.957035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:23.980227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:23.980860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:23.981139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:23.981442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:23.982445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] RBAC: Adding query filter params (name=image) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:23.982836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:23.984303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:23.990351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 367/730] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:23.996362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:24.146662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9abc-9cac-4c27-b106-b393f73c86e2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:24.206769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:24.217041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:24.218590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:24.219369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:24.220240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:24.221757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] RBAC: Adding query filter params (type=image) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:24.222594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:24.225533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe832f-6c0d-4102-9da0-df22fc687422 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:24.235267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 364/731] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:24.252526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:24.375587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd462-3f2f-45f2-ae00-2ac29128e043 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:24.415657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:24.416325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:24.416602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:24.416873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:24.417547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:24.419006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b082d-efd4-4e76-b464-5427eb9d1fdf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:24.439361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 368/732] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:24 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:25.343982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0262c-0831-4931-abf0-f0d44e2e788a None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:25.345057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0262c-0831-4931-abf0-f0d44e2e788a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:25.345569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0262c-0831-4931-abf0-f0d44e2e788a None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:25.347535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 365/733] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:25.354039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf109f1-faf2-47c3-ac00-7d6c43529a91 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:25.355018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf109f1-faf2-47c3-ac00-7d6c43529a91 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:25.355487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf109f1-faf2-47c3-ac00-7d6c43529a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:25.375403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ebf109f1-faf2-47c3-ac00-7d6c43529a91 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:25.377044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ebf109f1-faf2-47c3-ac00-7d6c43529a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:25.412479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:25.466371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 369/734] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:25.692366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea327a9-546b-4f05-8568-b7ac8bae7656 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:25.692662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea327a9-546b-4f05-8568-b7ac8bae7656 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:25.693112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea327a9-546b-4f05-8568-b7ac8bae7656 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:25.694511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 366/735] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:25.700811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:25.701182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:25.701417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:25.723721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:25.725475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:25.749885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea327a9-546b-4f05-8568-b7ac8bae7656 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:25.801332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 370/736] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:25.905741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea327a9-546b-4f05-8568-b7ac8bae7656 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:25.953198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:25.953828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:25.954112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:25.954387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:25.955072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:25.956721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:25.959528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING keystone.server.flask.common [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 15 13:36:25.982204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.sql.core [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:25.982204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:36:25.982204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [parameters: {'id': '39778c1d4b3345dbbde55765f09e9844', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 15 13:36:25.982204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39778c1d4b3345dbbde55765f09e9844.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39778c1d4b3345dbbde55765f09e9844. Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:25.990636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 15 13:36:25.991524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application yield resource Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.rollback() Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.force_reraise() Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise self.value Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application session.commit() Oct 15 13:36:25.992542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._prepare_impl() Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.flush() Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._flush(objects) Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application compat.raise_( Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application flush_context.execute() Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 15 13:36:25.993454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rec.execute(self) Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 15 13:36:25.996022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:25.998363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [parameters: {'id': '39778c1d4b3345dbbde55765f09e9844', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:26.000472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:26.007438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39778c1d4b3345dbbde55765f09e9844. Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.012093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 367/737] 10.222.0.33 () {60 vars in 1140 bytes} [Sat Oct 15 13:36:25 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:26.014972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.072511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.133402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:26.145796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58341-3209-4b3a-82cd-d6dc4518f929 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.191262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.192027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.192301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.192577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.193280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:26.206337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.208139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:26.223265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:26.225033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:26.226764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 371/738] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:26.231324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.278487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143669cd-8c68-453e-9bae-e725d3138e50 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.317901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.318558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.318844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.319120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.319716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.321552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:26.331730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:26.333958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:26.335835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:26.338235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 368/739] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:26.339206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.431953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207dd5-afa3-4f80-afe6-a0fc5c89f0d1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.453519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334a0b2-d826-491e-898d-1805058de325 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.473329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:26.493954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.494632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.494925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.495192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.495976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:26.496167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.497673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:26.504724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.505701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.506189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 369/740] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:26.506376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.506875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.508395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:26.509151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.512095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.512443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37938e09-7382-4a24-bbaf-4c7010308ccf None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:26.550105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 372/741] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:26.673575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdcde-da5a-4e91-b85e-14fcbc693fbc None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.674637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdcde-da5a-4e91-b85e-14fcbc693fbc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.675605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdcde-da5a-4e91-b85e-14fcbc693fbc None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.678629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 373/742] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:26.685002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.685822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.686481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.691232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0729b-bb71-4dc0-a177-53e666c30728 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.710127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:26.711946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:26.721695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:26.742862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.743737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.744182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.744659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.745916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:26.746314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.750018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:26.760172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 370/743] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:26.765937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:26.824631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 374/744] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:26.827839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:26.921560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0f70-d88c-46b3-bc52-8330dc6435a1 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:26.981978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:26.983374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:26.984058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:26.984711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:26.986185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] RBAC: Adding query filter params (interface=admin, service_id=14ed1dc236b7469aae04a77f6bd0e046, region_id=RegionOne) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:26.986902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:26.989699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:27.000682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 371/745] 10.222.0.33 () {56 vars in 1249 bytes} [Sat Oct 15 13:36:26 2022] GET /identity/v3/endpoints?service_id=14ed1dc236b7469aae04a77f6bd0e046&interface=admin®ion_id=RegionOne => generated 193 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:27.009450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:27.103813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:27.193446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c957-ce9b-4446-ae2a-da3324d4b1b2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:27.237757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:27.238308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:27.238584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:27.238861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:27.240739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:27.242208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1e99-4095-4e03-b820-af7fa2e2bd4d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:27.251903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 375/746] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:27 2022] GET /identity/v3/services => generated 1727 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:36:27.302541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ce32-b85d-4fdd-916b-b258613ce2d3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:27.322200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:27.340033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e26fb-6b6b-4794-8514-94301fdb9445 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:27.340385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e26fb-6b6b-4794-8514-94301fdb9445 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:27.340640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e26fb-6b6b-4794-8514-94301fdb9445 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:27.343708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 376/747] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:27.348569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:27.348906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:27.349123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:27.358475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:27.359723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:27.359723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:27.359723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:27.360381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:27.361846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:27.367234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:27.380933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 372/748] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:27 2022] POST /identity/v3/services => generated 242 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:27.385486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:27.386858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:27.505564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 377/749] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:27.922548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:28.112706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84c346-c6ae-4ef7-b03b-8b71a1ba5e5a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:28.166928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:28.167613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:28.167925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:28.168194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:28.168921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:28.170914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:28.181523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:28.183846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:28.185534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 373/750] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:28.198199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:28.395466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab3dc-4f38-467e-bda0-68f803d593ac None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:28.454153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:28.462097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:28.463158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:28.463588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:28.464047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:28.465129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:28.466390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:28.469571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:28.483866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 378/751] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:28.489523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:28.542171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:28.628156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cea1c-28c7-4e8c-aaa6-503b3a3fb9d2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:28.672783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:28.673436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:28.673758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:28.674034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:28.674702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:28.675005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:28.676522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:28.683004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 374/752] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:28.692734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:28.846996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d41f2e-9d55-431a-a067-68dd57329e9c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:28.887776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:28.888758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:28.889041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:28.889316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:28.890042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] RBAC: Adding query filter params (interface=public, service_id=3dfe68180cda4139a9513dbd6343545e, region_id=RegionOne) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:28.890352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:28.891742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f33ab-e5fc-478b-92f1-7ebf64e9463d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:28.898136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 379/753] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:28 2022] GET /identity/v3/endpoints?service_id=3dfe68180cda4139a9513dbd6343545e&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:28.906883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:29.081466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:29.094404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657e576-d499-4b41-98e5-0495803e64f3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:29.160534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:29.161579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:29.162057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:29.162609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:29.163762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:29.166313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42cfd-5e1e-4850-b15f-4f2fcc0277a7 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:29.180911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 375/754] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:28 2022] GET /identity/v3/services => generated 1957 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:36:29.615397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47239-5751-4bc8-8c8d-4d12ec62af1c None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:29.615716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47239-5751-4bc8-8c8d-4d12ec62af1c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:29.616166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c47239-5751-4bc8-8c8d-4d12ec62af1c None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:29.617602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 380/755] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:29.623860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6d45-c3a2-458a-a192-0c03dfaf64d6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:29.624138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6d45-c3a2-458a-a192-0c03dfaf64d6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:29.624437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6d45-c3a2-458a-a192-0c03dfaf64d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:29.644293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e4ba6d45-c3a2-458a-a192-0c03dfaf64d6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:29.645828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e4ba6d45-c3a2-458a-a192-0c03dfaf64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:29.727373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 376/756] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:29.959976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e7f0-5745-486b-b4d1-bc33121191d4 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:29.960542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e7f0-5745-486b-b4d1-bc33121191d4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:29.960921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486e7f0-5745-486b-b4d1-bc33121191d4 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:29.963712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 381/757] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:29.974797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:29.975415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:29.975915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:29.991682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486e7f0-5745-486b-b4d1-bc33121191d4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:29.998969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:30.000637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:30.064095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.101898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 377/758] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:30.117396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486e7f0-5745-486b-b4d1-bc33121191d4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.156278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.157311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.157726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.158126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.158869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.160477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-b244c1a3-1103-414a-a615-604e462691e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:30.170502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:30.171809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:30.172859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.175365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 382/759] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Oct 15 13:36:29 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:30.182410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.185027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8295b8c-df83-4877-8acd-e42388605f8e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.185717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8295b8c-df83-4877-8acd-e42388605f8e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.186184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8295b8c-df83-4877-8acd-e42388605f8e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.188173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 383/760] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:30.197569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.198838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.199115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.220035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.227716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:30.230855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:30.324226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 384/761] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:30 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:30.377625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759363b-de58-4e24-87b2-fdfb8b5e2fec None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.438338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.445144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.446214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.446694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.447145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.448300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] RBAC: Adding query filter params (name=image) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:30.449165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.452037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.466291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 378/762] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:30.468657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.539668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.581044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.602900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e887-e0d8-4924-8f03-025d47a9c1ca None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.643233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24720a3-01f0-42d3-a654-3069fc3578b2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.645024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.645743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.646081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.646418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.647131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] RBAC: Adding query filter params (type=image) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:30.647441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.648891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.655613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 379/763] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:30.656493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.690689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.691413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.691724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.692051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.692647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.694126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.696805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING keystone.server.flask.common [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 15 13:36:30.718419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.sql.core [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 15 13:36:30.718419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 15 13:36:30.718419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [parameters: {'user_id': 'eb69d8bb0584407f8c588cb8ffe98091', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 15 13:36:30.718419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87877) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:30.735088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:30.737035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application yield resource Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self.session.rollback() Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self.force_reraise() Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise self.value Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application session.commit() Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 15 13:36:30.738935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._prepare_impl() Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self.session.flush() Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._flush(objects) Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application compat.raise_( Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application flush_context.execute() Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rec.execute(self) Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 15 13:36:30.742272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:30.744293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:30.746245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [parameters: {'user_id': 'eb69d8bb0584407f8c588cb8ffe98091', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:30.749054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 15 13:36:30.752874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 385/764] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Oct 15 13:36:30 2022] POST /identity/v3/users => generated 160 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:30.754987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.802504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5e3a-22c3-42a4-a59c-bf25525ceee6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.843753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.844580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.844990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.845351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.846030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.847530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:30.858760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:30.860055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 13:36:30.861126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:30.862499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 380/765] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:30.863163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.881103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.913630 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c04f-7235-44ea-8227-208766615cb2 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:30.934908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:30.956804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:30.957618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:30.957995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:30.958374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:30.959191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] RBAC: Adding query filter params (interface=public, service_id=de1e18fa96ea4d8ebb6cb84dc2c950c4, region_id=RegionOne) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:30.959590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:30.961359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:30.978110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 386/766] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/endpoints?service_id=de1e18fa96ea4d8ebb6cb84dc2c950c4&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:30.978110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:30.997152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeefaf-9508-4e3d-9ac2-bc4857e6d003 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.038220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.039293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.039775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.040280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.054965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.058110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:31.081366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:31.082613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 13:36:31.083710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:31.084311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 381/767] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:31.085180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:31.118656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602100b-d8f4-4fb7-883d-2b9b70c18003 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.161692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.162324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.162600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.162867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.163513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:31.163841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.165250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.176987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 387/768] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:31.176987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:31.186938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:31.238390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808ee09-b2ac-4aab-b2da-8a27e5e68d70 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.251505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:31.296524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.297579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.298098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.298614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.299693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.302485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.323921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 382/769] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:36:31 2022] GET /identity/v3/services => generated 1957 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:36:31.323921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:31.358963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2aed8-d6c6-44ae-9b21-bb82a649c05a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.433757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.435954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.436456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.437375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.438804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:31.439335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.443361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.539727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 388/770] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Oct 15 13:36:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:31.549006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d24f27-fec0-4e3e-b8a2-4bae907e1359 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.607842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.608453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.608798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.609069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.609716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:31.610013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.611452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816bb0b-d37c-41e7-9492-f00accb1ad7e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.614401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:31.618356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 383/771] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Oct 15 13:36:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:31.629885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:31.827187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255c23-1722-4483-8908-ee0c8e69499a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:31.830194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:31.886216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:31.886754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:31.887031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:31.888029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:31.888725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:31.890137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c91df-6a24-4d75-9c13-ef0524a4ee05 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:31.912299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 389/772] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:32.717209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75309c-dec7-492b-967f-cf3b32ea52bf None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:32.717942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75309c-dec7-492b-967f-cf3b32ea52bf None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:32.717942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75309c-dec7-492b-967f-cf3b32ea52bf None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:32.719464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 384/773] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:32.727595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:32.728419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:32.728419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:32.749159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:32.750771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:32.880298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 390/774] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:32 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:33.152825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75309c-dec7-492b-967f-cf3b32ea52bf None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:33.273536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75309c-dec7-492b-967f-cf3b32ea52bf None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:33.311039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:33.311684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:33.312005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:33.312280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:33.312868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:33.314282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:33.324063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:33.328251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:33.329174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 385/775] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:33.336395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:33.482841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:33.507650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c44f4-c431-4fb8-ac23-dedc8d3afe41 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:33.577535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:33.578598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:33.579094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:33.579584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:33.580858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:33.581400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:33.584039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:33.602207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 391/776] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:33.604011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:33.721436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:33.770002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b230f97-5396-4299-9ddb-c7d14e33ec96 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:33.812419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:33.813057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:33.813407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:33.813685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:33.814346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:33.814648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:33.816129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb0b8-4171-4bb3-8272-0d40a7a87f9a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:33.831640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 386/777] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Oct 15 13:36:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:33.833032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:33.963874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134650d-6bd1-4e87-88e9-59a451a29de0 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:34.009145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:34.009982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:34.010391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:34.010801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:34.011640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:34.013656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaf87e-ec1c-4c21-ab0f-3a67c35fb056 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:34.044045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 392/778] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:34.323641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e5ff-e3c1-4184-9262-e26860d65ae7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:34.324340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e5ff-e3c1-4184-9262-e26860d65ae7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:34.324874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e5ff-e3c1-4184-9262-e26860d65ae7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:34.327513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 387/779] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:34.333821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f932bc-46c0-4c12-a59b-59b324c05dd1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:34.334122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f932bc-46c0-4c12-a59b-59b324c05dd1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:34.334419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f932bc-46c0-4c12-a59b-59b324c05dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:34.358994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-60f932bc-46c0-4c12-a59b-59b324c05dd1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:34.361051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-60f932bc-46c0-4c12-a59b-59b324c05dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:34.364852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:34.511903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 393/780] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:34.551335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a3e-6ede-4d7a-bec5-1cf52aee6c03 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:34.551678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a3e-6ede-4d7a-bec5-1cf52aee6c03 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:34.551940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a3e-6ede-4d7a-bec5-1cf52aee6c03 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:34.553344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 388/781] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:34.559476 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:34.560025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:34.560340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:34.581563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:34.582712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:34.663466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 394/782] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:34.934261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34a3e-6ede-4d7a-bec5-1cf52aee6c03 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.009926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.083196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34a3e-6ede-4d7a-bec5-1cf52aee6c03 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.094665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:35.134516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:35.148997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.150073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.150393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac37ed-4091-47af-bd96-9c6f1bf5cde1 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.150553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.151011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.153254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.156102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.159408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 389/783] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:35.169152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.199616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.201018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.201451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.201856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] PATH_INFO: `/v3/services/image` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.202597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.204586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:35.217277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:35.219271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:35.220313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 395/784] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Oct 15 13:36:35 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:35.228173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.355589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3787-69c3-4d97-b51c-c9992e19e428 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.378942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2c4c1-daf5-4434-bc91-ed1829808ddb None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.388731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:35.399124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.399759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.400065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.400494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.401612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:35.402128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.405258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.420232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 396/785] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:35.424480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.443611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.444656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.445143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.445648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.446834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.450132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.500246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 390/786] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:36:35 2022] POST /identity/v3/projects => generated 311 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:35.576915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b5ac-ef53-40f7-9878-58214f59e5e1 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.620195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.620844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.621115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.621506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.622248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] RBAC: Adding query filter params (type=image) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:35.622723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.624199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20620ba-7f0a-4efd-93ff-2d65ccf1efae None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.630832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 397/787] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:35.637832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:35.726333 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:35.808288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12a7c-22b6-4dc4-a039-1545268a6a95 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:35.863613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:35.864277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:35.864550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:35.864816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:35.865504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:35.866887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1034ad1-36ef-4ef4-bd63-dd8bf0e080b3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:35.894799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 391/788] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:36:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:36:36.611974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44a15c-619a-4db8-a5cd-275164e181cd None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:36.612548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44a15c-619a-4db8-a5cd-275164e181cd None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:36.612548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44a15c-619a-4db8-a5cd-275164e181cd None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:36.613911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 398/789] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:36.619527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:36.620042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:36.620143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:36.641501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:36.642737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:36.743091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 392/790] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:37.010815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44a15c-619a-4db8-a5cd-275164e181cd None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:37.119815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:37.205329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44a15c-619a-4db8-a5cd-275164e181cd None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:37.270116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:37.271122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:37.271621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:37.272138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:37.291973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:37.301889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:37.302907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:37.303750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:37.309670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 399/791] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:36:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:37.310717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:37.347670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:37.433949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0572-68df-408b-994a-048c504b1b39 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:37.472038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:37.472666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:37.472974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:37.473224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:37.473868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:37.474165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:37.475558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:37.485278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 393/792] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Oct 15 13:36:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:37.491022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:37.667862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47034cd-a49c-4442-9965-c5617a319e86 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:37.699465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:37.730220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:37.730917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:37.731192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:37.731460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:37.744289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:37.745771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:37.763204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:37.765065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:37.766808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:37.766808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:37.766808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:37.768157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 400/793] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:37.770359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:37.883483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:37.895762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be10a5-bf5d-49fb-a69f-cbcde31d666a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:37.938535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:37.939160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:37.939456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:37.939706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:37.940378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:37.940678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:37.942072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:37.956470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 394/794] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:37.962770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:38.146948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98844f8a-d2b0-4d39-88c1-e21c0e4fc967 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:38.205994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:38.206981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.207459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.207953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.218890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:38.220446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-5c5cf7c5-097c-4d54-80c8-14ff12461c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:38.233983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:38.236423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:36:38.238260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:38.240219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 401/795] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:36:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:38.241511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:38.366705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404f3a-4ac2-4d2e-8550-ee9ccddf1b3c None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:38.410558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fb62-fc4a-4b71-b4a0-4800e6e19a4e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.410852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fb62-fc4a-4b71-b4a0-4800e6e19a4e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.411308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fb62-fc4a-4b71-b4a0-4800e6e19a4e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.412686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 402/796] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:38.412841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:38.413192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.413466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.413785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.414467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:38.414765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:38.416256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:38.417925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.418358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.418783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.441542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:38.442780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:38.451401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 395/797] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:38.452620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:38.470051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:38.478772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:38.565441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 403/798] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:38.588713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521d0b-b381-48bd-a426-90d61156d7b3 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:38.633163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:38.633830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.634107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.634384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.648016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:38.649567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-f132f0fd-42ce-4d94-b17d-9a8b291d63de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:38.680603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:38.688689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:38.690479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:38.690479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:38.690479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:38.690479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 396/799] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:38.694025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:38.738803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968b0-75f3-4087-8ecf-49ae1a06fe85 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.739046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968b0-75f3-4087-8ecf-49ae1a06fe85 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.739355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968b0-75f3-4087-8ecf-49ae1a06fe85 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.741237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 397/800] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:38.747672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:38.748030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:38.748283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:38.768949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:38.770176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:38.841777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13b40-fc10-4e81-853c-1e658e6348e7 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:38.845598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:38.867853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 398/801] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:38.961187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.005129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.005779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.006060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.006396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.007056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:39.007357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.008780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.024657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 404/802] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:39.030605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.053533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:39.111872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddea6-515f-4bba-ab77-cc23717bb467 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.153987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a03b4-da52-4d07-956e-a99a45da6463 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.165797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.166628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.167073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.167520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.168856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.171399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.185369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.sql.core [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:39.185369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:36:39.185369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [parameters: {'id': '84dbb936862b47fba73b22b7a7074a20', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 15 13:36:39.185369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:39.193568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 15 13:36:39.194501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application yield resource Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application next(self.gen) Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.rollback() Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.force_reraise() Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise self.value Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application session.commit() Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 15 13:36:39.195432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._prepare_impl() Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.session.flush() Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._flush(objects) Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application compat.raise_( Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application flush_context.execute() Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rec.execute(self) Oct 15 13:36:39.196396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 15 13:36:39.197321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result = self._query(query) Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application conn.query(q) Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application result.read() Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 15 13:36:39.198495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [parameters: {'id': '84dbb936862b47fba73b22b7a7074a20', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 15 13:36:39.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:39.203388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 399/803] 10.222.0.33 () {60 vars in 1137 bytes} [Sat Oct 15 13:36:38 2022] POST /identity/v3/domains => generated 190 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:39.205706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.209043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.210249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.210729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.211189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.224595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.227410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:39.249571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:39.252341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:39.254477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 405/804] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:39.258052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.279759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:39.344908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe45b9-eb60-4858-832f-36c439d2b091 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.368656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:39.386136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.386914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.387357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.387823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.396936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0795-988b-4e81-a172-89dfd6696f3e None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.400066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.402050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:39.423689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:39.425662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:39.427300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:39.427300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:39.427300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:39.427300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 400/805] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:39.427300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.446542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.447311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.447643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.448345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.449766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:39.449766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.451752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.469962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 406/806] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:39.471379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.568265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ef26-e09c-425d-a87a-11ebacc5f4eb None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.580572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:39.621707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050f748-451f-4bba-9785-a4c077fe2435 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.622776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.623638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.624063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.624480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.625817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.627379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.629207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 401/807] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:39.630119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.670655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.671723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.672288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.672785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.673944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:39.674483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.677062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.690625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:39.701450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 407/808] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:39.703062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:39.776319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e547-ca1e-4926-b497-589f195f2407 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.825506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.826092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.826367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.826637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/38b3e00dd4ec430487475150b217f921` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.829051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=b10284800d0248778a9b4ece037e3343, role_id=38b3e00dd4ec430487475150b217f921)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.830580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42252-adf0-40ba-aa00-274dfef9dd3e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:39.850599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 402/809] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:36:39 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/b10284800d0248778a9b4ece037e3343/roles/38b3e00dd4ec430487475150b217f921 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:36:39.890958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedfff-660d-4c5c-b874-69d9cea9c2aa None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:39.969770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:39.971187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:39.971602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:39.972061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:39.973178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:39.975721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0036d-e15d-43cc-8f1e-729ca5d17a1a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:40.016166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 408/810] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:36:39 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:42.248590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d713-bcc0-4515-9942-af562245fdf0 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.249429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d713-bcc0-4515-9942-af562245fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.249429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1d713-bcc0-4515-9942-af562245fdf0 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.250769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 403/811] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:42.256282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.256982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.256982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.271649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506058-ac2a-4715-8d7e-0635c6164a6d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.272192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506058-ac2a-4715-8d7e-0635c6164a6d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.272665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506058-ac2a-4715-8d7e-0635c6164a6d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.274984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 404/812] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:42.276336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:42.278258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:42.282012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.282498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.282976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.314570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:42.316640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:42.333207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:42.355441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 409/813] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:42.373350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:42.446005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 405/814] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:36:42.623324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:42.717932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:42.743048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314054-8995-4eaa-93ba-fbfa5386abbc None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:42.788184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:42.789167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.789602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.790043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.806111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:42.814680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:42.816057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:42.818299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 410/815] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Oct 15 13:36:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:42.826457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:42.859941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab00b-5d3c-4d4e-93a2-225a5ace94ac None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:42.885398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:42.898032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:42.898742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:42.899026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:42.899297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:42.910819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:42.915754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:42.917323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:42.918911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 406/816] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:42.923820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:42.957114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:42.958352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9762-087f-4796-a82d-4f40e8936905 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.005868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.006819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.007259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.007688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.008833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:43.009317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.011850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.023408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 411/817] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Oct 15 13:36:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.029751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.067168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e410e-cd40-437c-aae4-d2aff121a861 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.115062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.116147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.116600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.117078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.118215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:43.118694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.121351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.137428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 407/818] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.144749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.154107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c313a-3dd9-4110-a78c-04ec6200257c None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.162179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:43.193999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.194735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.195087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.195468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.207871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.209334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:43.225552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:43.227442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:43.229262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:43.229262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:43.229262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:43.229262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 412/819] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:43.236140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.273077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:43.289032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef7e5-4bef-4e7e-9697-3fe4f22c8607 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.328858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.329510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.329784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.330059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] PATH_INFO: `/v3/users/7bfa2023a9cf410abdec38557e2b5966` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.344940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] RBAC: Authorizing `identity:get_user(user_id=7bfa2023a9cf410abdec38557e2b5966)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.346463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.348199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 408/820] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/users/7bfa2023a9cf410abdec38557e2b5966 => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.354160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.380354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b24d73-4598-472a-b18b-fb513d2c44e3 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.422495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.423122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.423401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.423672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.424369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:43.424679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.426084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.439496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 413/821] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.445454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.465418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:43.507702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683102f0-9ebb-4432-a4fc-d95e7480cc07 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.554050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd8b-483f-48d9-90c3-2546edc7cc07 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.569113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.570186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.570671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.571169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.573657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] RBAC: Authorizing `identity:get_project(project_id=8c780d729da8403f8161b24bf1624214)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.576677 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.585509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 409/822] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/projects/8c780d729da8403f8161b24bf1624214 => generated 311 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.587529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.592059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.592734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.593008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.593278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.601153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.602618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:36:43.615393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:43.617233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:43.619093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 414/823] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:43.620749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:43.622952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.717992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:43.746382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125bc78-158f-4415-bd09-52b3ab7194ac None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.789535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.790174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.790448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.790715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.791489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:43.791779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.793618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.815011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 415/824] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:43.821658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:43.916756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce9dee-8bdf-4fdc-abf6-bae0f12fe49d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.957637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01359968-5f2d-4b66-8d62-7dc2d18b2a30 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:43.973571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:43.974173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:43.974449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:43.974712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214/users/7bfa2023a9cf410abdec38557e2b5966/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:43.977405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c780d729da8403f8161b24bf1624214, user_id=7bfa2023a9cf410abdec38557e2b5966, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:43.979978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:43.997912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 410/825] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:36:43 2022] PUT /identity/v3/projects/8c780d729da8403f8161b24bf1624214/users/7bfa2023a9cf410abdec38557e2b5966/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:36:44.010142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:44.011273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:44.011763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:44.012270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:44.019638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:44.114372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:44.117004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:44.265480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 416/826] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:36:44.272112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:44.393435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:44.424853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc61ef-dbfe-4ae4-9cd4-e82d0542cfc0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:44.462861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:44.463585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:44.463968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:44.464300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:44.476518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:44.478009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:36:44.494083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:44.495761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:36:44.497581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:36:44.497581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:36:44.497581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:44.497581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 411/827] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:44.502204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:44.559456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:44.634595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912101-29db-4b3a-9f2e-923cbc99c5b5 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:44.672854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:44.673484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:44.673763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:44.674034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:44.674694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:44.674996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:44.676424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:44.689580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 417/828] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:44.695481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:44.828330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5ccb-f0dd-4dd3-9aae-bce3ee909b16 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:44.859264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:44.869884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:44.870555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:44.870880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:44.871238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:44.879664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:44.881200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:36:44.893861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:44.894872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:36:44.895811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 412/829] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:36:44.901813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:45.018247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:45.025783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf76-ef8a-4028-bbf8-0183c2ed7402 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:45.066295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:45.067039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:45.067411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:45.067643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:45.068391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:45.068688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:45.070185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f22c19-9964-4197-9fc8-2ed52ac7c3fe None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:45.085325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 418/830] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:45.092281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:45.230617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a42b-066a-43a1-b273-87e1e01cfd18 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:45.271072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:45.271763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:45.272139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:45.272461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:45.273195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] RBAC: Adding query filter params (role.id=38b3e00dd4ec430487475150b217f921, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=b10284800d0248778a9b4ece037e3343) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:45.273497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:45.274972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90195-30e7-4c3d-9dd1-8b9d26a7d563 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:45.281750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 413/831] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:45 2022] GET /identity/v3/role_assignments?user.id=b10284800d0248778a9b4ece037e3343&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=38b3e00dd4ec430487475150b217f921 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:46.263912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ce1a-acca-434f-8f21-3c5642719cc5 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:46.264712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ce1a-acca-434f-8f21-3c5642719cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:46.264712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ce1a-acca-434f-8f21-3c5642719cc5 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:46.265825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 419/832] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:36:46.275138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:46.275891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:46.276215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:46.307053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:46.309093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:46.374253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:46.397397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 414/833] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:46.661843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ce1a-acca-434f-8f21-3c5642719cc5 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:46.781245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ce1a-acca-434f-8f21-3c5642719cc5 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:46.818687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:46.819337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:46.819604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:46.819902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:46.831900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:36:46.836794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:36:46.838527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:36:46.840165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 420/834] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:36:46.844725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:46.957656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d174c7a-a119-4bdf-b783-08001f163966 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:46.994746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:46.995353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:46.996495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:46.996899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:46.997584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:46.997882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:46.999281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:47.008430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 415/835] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:36:47.015468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:47.037946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:47.130057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ad1a-a79c-4719-a6f6-005460a31b4a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:47.169126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:47.169772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:47.170156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:47.170429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] PATH_INFO: `/v3/users/7bfa2023a9cf410abdec38557e2b5966` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:47.171587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] RBAC: Authorizing `identity:get_user(user_id=7bfa2023a9cf410abdec38557e2b5966)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:47.173071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:47.174674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 421/836] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:47 2022] GET /identity/v3/users/7bfa2023a9cf410abdec38557e2b5966 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:47.180808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:47.228366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:47.295425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a5995-be12-4c5d-92b2-08f16d78c2c8 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:47.332563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:47.333192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:47.333481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:47.333855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:47.417506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:47.419387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:47.471154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:47.542812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 416/837] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:36:47.550010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:47.701463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:47.724059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da05f3-13eb-4170-be2a-038d4f403eba None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:47.764038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:47.764745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:47.765066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:47.765379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:47.766681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] RBAC: Authorizing `identity:get_project(project_id=8c780d729da8403f8161b24bf1624214)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:47.768277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f4da0-bb91-45a9-83c9-f42a8dcd5f56 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:47.769980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 422/838] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:36:47 2022] GET /identity/v3/projects/8c780d729da8403f8161b24bf1624214 => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:47.777062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:47.888944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010fb36-c53f-4004-aea0-4df879280921 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:47.928112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:47.928727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:47.929001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:47.929267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:47.929993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=8c780d729da8403f8161b24bf1624214, user.id=7bfa2023a9cf410abdec38557e2b5966) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:47.930292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:47.931734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6be79-3ae8-436d-b38a-e53fc0b7eb0e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:47.939644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 417/839] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:47 2022] GET /identity/v3/role_assignments?user.id=7bfa2023a9cf410abdec38557e2b5966&scope.project.id=8c780d729da8403f8161b24bf1624214&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:50.164368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c5be-8919-46cf-a225-44eb3a01ceb9 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:50.164948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c5be-8919-46cf-a225-44eb3a01ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:50.164948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c5be-8919-46cf-a225-44eb3a01ceb9 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:50.166387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 423/840] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:50.173211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:50.173824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:50.173824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:50.188733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:50.195051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:50.196316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:50.271807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 418/841] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:50.540310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c5be-8919-46cf-a225-44eb3a01ceb9 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:50.656259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c5be-8919-46cf-a225-44eb3a01ceb9 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:50.692734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:50.693380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:50.693658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:50.693920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:50.695164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:50.696656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc43b-fb82-4506-b225-3222e4169dfb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:50.698891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 424/842] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:36:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:50.707759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:50.822027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf87397-dcc2-4293-a416-3e5f6c6d3628 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:50.863805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:50.864464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:50.864743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:50.865011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:50.865712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:50.867229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1dfa-b0f8-4f60-b508-88f578e61173 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:50.877993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:50.895008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 419/843] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:36:50 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:36:53.133812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11269-139e-4e09-a5cf-3ab4a9eecfc0 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:53.134604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11269-139e-4e09-a5cf-3ab4a9eecfc0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:53.134604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11269-139e-4e09-a5cf-3ab4a9eecfc0 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:53.135953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 425/844] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:53.142241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:53.142766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:53.142893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:53.163669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:53.164945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:53.246423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 420/845] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:53.516406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11269-139e-4e09-a5cf-3ab4a9eecfc0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:53.540401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:53.624246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11269-139e-4e09-a5cf-3ab4a9eecfc0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:53.661247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:53.662067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:53.662389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:53.662729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] PATH_INFO: `/v3/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:53.664404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] RBAC: Authorizing `identity:get_role(role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:53.665790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:53.667191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 426/846] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:53 2022] GET /identity/v3/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:53.673786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:53.800203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871c675-4f35-4807-9cc7-9557ac3d3bab None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:53.831221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:53.845412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:53.846076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:53.846357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:53.846630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] PATH_INFO: `/v3/users/8ea75e6fcf9a4d6e9c37de8088439e68` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:53.863697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] RBAC: Authorizing `identity:get_user(user_id=8ea75e6fcf9a4d6e9c37de8088439e68)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:53.865247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:53.867023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 421/847] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:53 2022] GET /identity/v3/users/8ea75e6fcf9a4d6e9c37de8088439e68 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:53.874091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:53.986005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:54.006948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8934-f02f-46c3-8557-f795b8c93dbd None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:54.066755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:54.067562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:54.067880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:54.068158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:54.069802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] RBAC: Authorizing `identity:get_project(project_id=8c780d729da8403f8161b24bf1624214)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:54.071712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e43c-4e2c-469e-bfff-5e2588d21f96 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:54.073999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 427/848] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:36:53 2022] GET /identity/v3/projects/8c780d729da8403f8161b24bf1624214 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:54.080640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:54.196842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c41c8-aae3-4803-9143-78d9fba3d77d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:54.237060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:54.237747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:54.238026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:54.238299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214/users/8ea75e6fcf9a4d6e9c37de8088439e68/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:54.240549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c780d729da8403f8161b24bf1624214, user_id=8ea75e6fcf9a4d6e9c37de8088439e68, role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:54.242033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bce82c-b120-4c48-b87a-b2b41dcbc821 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:54.258430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 422/849] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:36:54 2022] PUT /identity/v3/projects/8c780d729da8403f8161b24bf1624214/users/8ea75e6fcf9a4d6e9c37de8088439e68/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:36:56.459960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a696-ea2b-48ea-95b6-9dcad80fe181 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:56.460523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a696-ea2b-48ea-95b6-9dcad80fe181 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:56.460523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a696-ea2b-48ea-95b6-9dcad80fe181 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:56.461879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 428/850] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:36:56.467772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:56.468323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:56.468323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:56.488909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:36:56.489782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:36:56.527147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:56.565020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 423/851] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:36:56.835959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0a696-ea2b-48ea-95b6-9dcad80fe181 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:56.954272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0a696-ea2b-48ea-95b6-9dcad80fe181 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:56.991698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:56.992252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:56.992529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:56.992797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] PATH_INFO: `/v3/roles/0a15993814224f1fbf73bd70a958b9c5` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:56.994233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] RBAC: Authorizing `identity:get_role(role_id=0a15993814224f1fbf73bd70a958b9c5)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:56.995668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:56.997166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 429/852] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:56 2022] GET /identity/v3/roles/0a15993814224f1fbf73bd70a958b9c5 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:57.006890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:57.136862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f93d-38af-4d9d-a698-dc2966199588 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:57.173616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:57.174310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:57.174625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:57.174936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] PATH_INFO: `/v3/users/8ea75e6fcf9a4d6e9c37de8088439e68` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:57.176210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] RBAC: Authorizing `identity:get_user(user_id=8ea75e6fcf9a4d6e9c37de8088439e68)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:57.177720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:57.179360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 424/853] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:36:57 2022] GET /identity/v3/users/8ea75e6fcf9a4d6e9c37de8088439e68 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:57.185853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:57.212909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:57.293825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b49e82-c62c-4a39-bb4d-1adcc6be7368 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:57.331013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:57.331634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:57.331941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:57.332211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:57.415084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:57.416620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:57.447092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:57.535191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 430/854] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:36:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:36:57.541563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:57.588423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:57.662083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cae77-ff25-484d-9dd2-fa8f762f8425 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:57.714287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:57.714971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:57.715279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:57.715547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] PATH_INFO: `/v3/projects/8c780d729da8403f8161b24bf1624214` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:57.717008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8c780d729da8403f8161b24bf1624214)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:57.718526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca87dac-e23c-4d05-a66b-d4ac0e4892d5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:57.720343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 425/855] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:36:57 2022] GET /identity/v3/projects/8c780d729da8403f8161b24bf1624214 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:36:57.730800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:36:57.850356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ec40a-a468-40d8-b337-7a2b14ea3243 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:36:57.878186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:36:57.890102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:36:57.890699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:36:57.891003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:36:57.891278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:36:57.892054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] RBAC: Adding query filter params (role.id=0a15993814224f1fbf73bd70a958b9c5, scope.project.id=8c780d729da8403f8161b24bf1624214, user.id=8ea75e6fcf9a4d6e9c37de8088439e68) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:36:57.892360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:36:57.893810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63935-20d9-422f-a2bc-935a4f7bc2bc None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:36:57.900444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 431/856] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:36:57 2022] GET /identity/v3/role_assignments?user.id=8ea75e6fcf9a4d6e9c37de8088439e68&scope.project.id=8c780d729da8403f8161b24bf1624214&role.id=0a15993814224f1fbf73bd70a958b9c5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:37:00.100302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294e58-ea69-4c7c-93f7-c805553c5c47 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:00.100863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294e58-ea69-4c7c-93f7-c805553c5c47 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:00.100863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294e58-ea69-4c7c-93f7-c805553c5c47 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:00.102101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 426/857] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:00.109586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:00.110148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:00.110540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:00.140059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:00.142012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:00.219936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 432/858] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:00.510583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab294e58-ea69-4c7c-93f7-c805553c5c47 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:00.614605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab294e58-ea69-4c7c-93f7-c805553c5c47 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:00.622964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:00.654321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:00.655003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:00.655285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:00.655560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:00.657097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:00.658656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680015a-6d5d-4014-a236-3b513e508b0b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:00.660547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 427/859] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:37:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:00.667281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:00.797065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad52b7-0726-43f1-9428-cdaf1e963e08 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:00.818309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:00.838893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:00.839504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:00.839828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:00.840091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:00.840760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:00.842217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d46e3-4648-4fce-bca4-c420454f7c20 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:00.872269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 433/860] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:37:00 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:37:03.087652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83ba34-3985-4277-9e60-dce1769d3e00 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:03.088269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83ba34-3985-4277-9e60-dce1769d3e00 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:03.088269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83ba34-3985-4277-9e60-dce1769d3e00 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:03.090467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 428/861] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:03.095573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:03.096118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:03.096118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:03.116156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:03.117381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:03.189266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 434/862] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:03.453503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83ba34-3985-4277-9e60-dce1769d3e00 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:03.567274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83ba34-3985-4277-9e60-dce1769d3e00 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:03.604734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:03.605550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:03.605828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:03.606097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:03.607282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:03.608783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbad92-ee53-4315-b48b-9efc94504d0d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:03.610406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 429/863] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:37:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:03.616543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:03.723014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:03.726653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b5829-35ef-4c96-b126-815dbc03829f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:03.765245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:03.765864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:03.766134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:03.766434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:03.767147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:03.768665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552f1c-e32f-4b1a-837b-692266596fde None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:03.792345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 435/864] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:37:03 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:37:06.045174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e8ca-16e9-4efd-b6fb-8d532644f0fd None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:06.045739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e8ca-16e9-4efd-b6fb-8d532644f0fd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:06.045739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e8ca-16e9-4efd-b6fb-8d532644f0fd None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:06.046967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 430/865] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:06.053061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:06.053567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:06.053567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:06.073458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:06.074651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:06.154057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 436/866] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:37:06.436543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009e8ca-16e9-4efd-b6fb-8d532644f0fd None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:06.485710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:06.547701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009e8ca-16e9-4efd-b6fb-8d532644f0fd None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:06.585711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:06.586348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:06.586623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:06.586886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:06.598377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:37:06.603192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:37:06.604473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:06.605494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:37:06.607985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 431/867] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:37:06.611239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:06.699007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:06.719707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e389-b74e-449e-9df0-ebc54f44d1e0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:06.761265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:06.761934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:06.762273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:06.762546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:06.763465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:06.763917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:06.765817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:06.777030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 437/868] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:06.783932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:06.892188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa5c-7ac4-4e72-ac9e-cdb60847bbc4 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:06.893930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:06.935561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:06.936227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:06.936498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:06.936770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] PATH_INFO: `/v3/users/dc232f40fc144e478e2950acfd1f5ebe` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:06.951252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=dc232f40fc144e478e2950acfd1f5ebe)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:06.952671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:06.954360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 432/869] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:37:06 2022] GET /identity/v3/users/dc232f40fc144e478e2950acfd1f5ebe => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:06.960877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:07.074220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8515d-07a8-4fcf-bc50-e30e964b6eb5 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:07.110775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:07.111414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:07.111687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:07.111995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] PATH_INFO: `/v3/projects/b988cbc63ba3460fabb46a876617ac25` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:07.113175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] RBAC: Authorizing `identity:get_project(project_id=b988cbc63ba3460fabb46a876617ac25)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:07.114605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083eba1-0f72-441e-ab1b-aeea3ca9f667 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:07.116313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 438/870] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:37:06 2022] GET /identity/v3/projects/b988cbc63ba3460fabb46a876617ac25 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:07.123024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:07.232525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73734-11b0-4820-a1a2-9b324ae3c1a6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:07.269489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:07.270162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:07.270440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:07.270711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] PATH_INFO: `/v3/projects/b988cbc63ba3460fabb46a876617ac25/users/dc232f40fc144e478e2950acfd1f5ebe/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:07.272740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] RBAC: Authorizing `identity:create_grant(project_id=b988cbc63ba3460fabb46a876617ac25, user_id=dc232f40fc144e478e2950acfd1f5ebe, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:07.274211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58542efb-1a05-482c-87ed-5f8381f41827 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:07.288476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 433/871] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:37:07 2022] PUT /identity/v3/projects/b988cbc63ba3460fabb46a876617ac25/users/dc232f40fc144e478e2950acfd1f5ebe/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:37:09.449779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b69a7-0952-4c82-a109-7bafbd548958 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:09.450392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b69a7-0952-4c82-a109-7bafbd548958 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:09.450392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b69a7-0952-4c82-a109-7bafbd548958 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:09.451695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 439/872] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:09.457383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:09.457818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:09.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:09.477491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:09.479096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:09.494426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:09.558282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 434/873] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:09.829223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b69a7-0952-4c82-a109-7bafbd548958 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:09.852363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:09.941890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b69a7-0952-4c82-a109-7bafbd548958 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:09.982941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:09.983467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:09.983744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:09.984047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:09.995819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:37:10.000699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:37:10.001709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:37:10.002567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 440/874] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:37:10.008167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:10.114032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04da85-72b9-4fce-89d9-bcdae7b4b423 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:10.150252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:10.151069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:10.151346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:10.151614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:10.152307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:10.152608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:10.154001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:10.162278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 435/875] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:10.168694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:10.256195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:10.281038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fdfed-125d-4f23-91d4-5f59de77ef40 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:10.317161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:10.317795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:10.318073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:10.318349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] PATH_INFO: `/v3/users/dc232f40fc144e478e2950acfd1f5ebe` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:10.319713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] RBAC: Authorizing `identity:get_user(user_id=dc232f40fc144e478e2950acfd1f5ebe)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:10.321654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:10.324877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 441/876] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:37:10 2022] GET /identity/v3/users/dc232f40fc144e478e2950acfd1f5ebe => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:10.330906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:10.347887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:10.446941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb42a0-5436-4696-bc79-dcf5847e835e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:10.483012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:10.483707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:10.483898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:10.484169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:10.558238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:10.559663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:10.578052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:10.680915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 436/877] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:37:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:37:10.688423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:10.818925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d16f9-38b5-4bed-ad0a-fd9b169c207d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:10.863102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:10.863944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:10.864287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:10.864617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] PATH_INFO: `/v3/projects/b988cbc63ba3460fabb46a876617ac25` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:10.865778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] RBAC: Authorizing `identity:get_project(project_id=b988cbc63ba3460fabb46a876617ac25)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:10.867205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822070-1cd0-4e3c-9f58-01c2c9be0163 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:10.868950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 442/878] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:37:10 2022] GET /identity/v3/projects/b988cbc63ba3460fabb46a876617ac25 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:10.877640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:10.986592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5287b-70ba-481b-ae2e-a7361dea8b59 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:11.001388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:11.026259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:11.026881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:11.027904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:11.028197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:11.029310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=b988cbc63ba3460fabb46a876617ac25, user.id=dc232f40fc144e478e2950acfd1f5ebe) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:11.029623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:11.031088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f579fb-ba86-470e-8e95-0fb421c0a644 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:11.040231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 437/879] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:37:10 2022] GET /identity/v3/role_assignments?user.id=dc232f40fc144e478e2950acfd1f5ebe&scope.project.id=b988cbc63ba3460fabb46a876617ac25&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:13.204287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f196969-31cf-4126-ac3a-d90a700396ce None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:13.204861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f196969-31cf-4126-ac3a-d90a700396ce None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:13.204861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f196969-31cf-4126-ac3a-d90a700396ce None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:13.206174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 443/880] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:13.211516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e3ab1-56ee-461c-ab28-70d80a234fa9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:13.211973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e3ab1-56ee-461c-ab28-70d80a234fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:13.212076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e3ab1-56ee-461c-ab28-70d80a234fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:13.230698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ea7e3ab1-56ee-461c-ab28-70d80a234fa9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:13.231917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ea7e3ab1-56ee-461c-ab28-70d80a234fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:13.301248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 438/881] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:13.568569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f196969-31cf-4126-ac3a-d90a700396ce None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:13.584651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:13.690384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f196969-31cf-4126-ac3a-d90a700396ce None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:13.730523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:13.731141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:13.731413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:13.731681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:13.732377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:13.733761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392907-ad7a-4758-8291-ca41c8d5c71d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:13.753392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 444/882] 10.222.0.33 () {60 vars in 1138 bytes} [Sat Oct 15 13:37:13 2022] POST /identity/v3/domains => generated 267 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:37:15.927563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac189e8-62a7-4bef-865f-f7dba6638cc0 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:15.928185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac189e8-62a7-4bef-865f-f7dba6638cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:15.928185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac189e8-62a7-4bef-865f-f7dba6638cc0 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:15.929484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 439/883] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:15.935007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:15.935440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:15.935543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:15.954963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:15.956198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:16.032167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 445/884] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:16.294258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac189e8-62a7-4bef-865f-f7dba6638cc0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:16.401500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac189e8-62a7-4bef-865f-f7dba6638cc0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:16.409604 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:16.437919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:16.438546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:16.438819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:16.439082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] PATH_INFO: `/v3/domains/6773c1c12fed45efbe7741c2731ffe1f` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:16.450100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6773c1c12fed45efbe7741c2731ffe1f)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:16.451547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1190-a2fe-461e-9bf7-e130ce35b006 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:16.453185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 440/885] 10.222.0.33 () {56 vars in 1183 bytes} [Sat Oct 15 13:37:16 2022] GET /identity/v3/domains/6773c1c12fed45efbe7741c2731ffe1f => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:16.461245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:16.463614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:16.565551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411996a7-03a8-41e0-ac22-427d8a94eabf None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:16.601602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:16.602236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:16.602513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:16.602766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:16.603451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:16.604912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bdf3-82b4-4eb5-a5e9-9cc2b6de5351 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:16.635424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 446/886] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:37:16 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:37:18.811830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96256f18-7fd0-4c67-a5f5-72ce8d591fa7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:18.812425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96256f18-7fd0-4c67-a5f5-72ce8d591fa7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:18.812425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96256f18-7fd0-4c67-a5f5-72ce8d591fa7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:18.813747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 441/887] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:18.819052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:18.819487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:18.819576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:18.838912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:18.840126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:18.890549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:18.910018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 447/888] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:19.173379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96256f18-7fd0-4c67-a5f5-72ce8d591fa7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:19.281138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96256f18-7fd0-4c67-a5f5-72ce8d591fa7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:19.319171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:19.319828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:19.320107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:19.320722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] PATH_INFO: `/v3/domains/6773c1c12fed45efbe7741c2731ffe1f` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:19.322015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6773c1c12fed45efbe7741c2731ffe1f)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:19.323459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eae0c2-cfde-4c1d-bf59-298db35a9c95 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:19.325151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 442/889] 10.222.0.33 () {56 vars in 1183 bytes} [Sat Oct 15 13:37:19 2022] GET /identity/v3/domains/6773c1c12fed45efbe7741c2731ffe1f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:19.331269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:19.435143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9354-797f-4bfc-aa2c-ae327ff7984b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:19.475437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:19.476095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:19.476367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:19.476633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:19.477293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:19.478794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7162f15-df87-4056-b10c-ef1bd9f1716a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:19.502104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 448/890] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:37:19 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:37:21.692207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fae64-0649-4aab-9cd2-6b2153f4d3b6 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:21.692796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fae64-0649-4aab-9cd2-6b2153f4d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:21.692796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fae64-0649-4aab-9cd2-6b2153f4d3b6 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:21.694190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 443/891] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:21.700000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:21.700445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:21.700538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:21.720459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:21.721669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:21.758985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:21.793689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 449/892] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:22.063022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fae64-0649-4aab-9cd2-6b2153f4d3b6 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:22.100917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:22.173771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fae64-0649-4aab-9cd2-6b2153f4d3b6 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:22.211330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:22.211985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:22.212264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:22.212525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:22.223052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:37:22.227881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:37:22.229008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:37:22.230021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 444/893] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:37:22.235299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:22.341819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a7f1-e96c-4924-9d8b-c4423742c64e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:22.377268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:22.377875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:22.378145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:22.378412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:22.379070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:22.379390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:22.380792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:22.389639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 450/894] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:37:22.395794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:22.506544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:22.513741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cdf0b-c39e-444c-9521-4aa5bbe8666a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:22.548824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:22.549493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:22.549770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:22.550035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] PATH_INFO: `/v3/users/c6b925c10059427ea6d86d05414de84c` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:22.564391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] RBAC: Authorizing `identity:get_user(user_id=c6b925c10059427ea6d86d05414de84c)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:22.565870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:22.567506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 445/895] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:37:22 2022] GET /identity/v3/users/c6b925c10059427ea6d86d05414de84c => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:22.574000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:22.606261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:22.677143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dd88-e116-44a4-8884-1f688f0fca49 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:22.714208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:22.714208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:22.714970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:22.714970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] PATH_INFO: `/v3/projects/75605b257bc3450885614e7320b477d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:22.715922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] RBAC: Authorizing `identity:get_project(project_id=75605b257bc3450885614e7320b477d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:22.717403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef5e6-275e-4c6d-bbf1-68c78194c29a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:22.719074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 451/896] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:37:22 2022] GET /identity/v3/projects/75605b257bc3450885614e7320b477d1 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:22.725538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:22.830840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e7ca-e04b-4160-a391-e6cdc0829bbe None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:22.868435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:22.869037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:22.869310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:22.869577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] PATH_INFO: `/v3/projects/75605b257bc3450885614e7320b477d1/users/c6b925c10059427ea6d86d05414de84c/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:22.871608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=75605b257bc3450885614e7320b477d1, user_id=c6b925c10059427ea6d86d05414de84c, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:22.873312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c3b0-0500-44e7-a3c2-8912fbcce1b3 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:22.889276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 446/897] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:37:22 2022] PUT /identity/v3/projects/75605b257bc3450885614e7320b477d1/users/c6b925c10059427ea6d86d05414de84c/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:37:25.030408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703d65-cb95-4af5-8255-1ef982922c41 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:25.030942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703d65-cb95-4af5-8255-1ef982922c41 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:25.030942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703d65-cb95-4af5-8255-1ef982922c41 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:25.032256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 452/898] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:37:25.037779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:25.038215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:25.038306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:25.057351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:37:25.058556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:37:25.066295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:25.130405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 447/899] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:37:25.399598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703d65-cb95-4af5-8255-1ef982922c41 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:25.499719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:25.504607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703d65-cb95-4af5-8255-1ef982922c41 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:25.541985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:25.542613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:25.542886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:25.543154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:25.553409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:37:25.558293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:37:25.559435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:37:25.560330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 453/900] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:37:25.565749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:25.666447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8179-5d69-43ac-8f22-f48cced2088b None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:25.703650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:25.704307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:25.704585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:25.704852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:25.705510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:25.705805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:25.707198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:25.717363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 448/901] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:25.725674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:25.834813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fae49-836b-4f8f-acb6-2079971f75a8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:25.872271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:25.872905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:25.873184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:25.873456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] PATH_INFO: `/v3/users/c6b925c10059427ea6d86d05414de84c` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:25.874632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6b925c10059427ea6d86d05414de84c)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:25.876099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:25.877708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 454/902] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Oct 15 13:37:25 2022] GET /identity/v3/users/c6b925c10059427ea6d86d05414de84c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:25.884227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:25.888530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:25.989968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023f9b-176d-4f0f-acf7-effff501c426 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:26.024931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:26.025536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:26.025811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:26.026071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:26.096153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:26.097612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:26.100352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:26.199454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 449/903] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:37:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:37:26.205733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:26.241485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:26.322216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d6f5-99d8-4ca1-b492-d590afd61fd4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:26.358357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:26.358989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:26.359239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:26.359522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] PATH_INFO: `/v3/projects/75605b257bc3450885614e7320b477d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:26.360768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] RBAC: Authorizing `identity:get_project(project_id=75605b257bc3450885614e7320b477d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:26.362187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14253-1c3d-4ee5-8162-6f73af421e9b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:26.363861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 455/904] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Oct 15 13:37:26 2022] GET /identity/v3/projects/75605b257bc3450885614e7320b477d1 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:26.371489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:37:26.483007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960cc5-760c-4911-96ab-3430005bfce6 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:37:26.485775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:26.520577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:37:26.521099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:37:26.521371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:37:26.521640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:37:26.522382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=75605b257bc3450885614e7320b477d1, user.id=c6b925c10059427ea6d86d05414de84c) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:37:26.522688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:37:26.524348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9034e-845c-4185-ae21-53407e179233 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:37:26.531588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 450/905] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:37:26 2022] GET /identity/v3/role_assignments?user.id=c6b925c10059427ea6d86d05414de84c&scope.project.id=75605b257bc3450885614e7320b477d1&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:37:36.353425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=52 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:37:36.528829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=16 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:23.560272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b5bd-3570-4f63-acaa-245da485e8d3 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:23.560911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b5bd-3570-4f63-acaa-245da485e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:23.560911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b5bd-3570-4f63-acaa-245da485e8d3 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:23.562202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 456/906] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:23.570708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:23.570708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:23.570708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:23.593479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:23.594692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:23.709227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 451/907] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:24.009200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b5bd-3570-4f63-acaa-245da485e8d3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:24.182545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b5bd-3570-4f63-acaa-245da485e8d3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:24.241698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:24.242448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:24.242826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:24.243096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:24.262312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:24.263750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:24.286613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:24.287705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:24.288716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:24.288716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:24.288716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:24.288716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 457/908] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:24.295073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:24.458023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a4265-1726-49c1-9d96-3c621303b8e3 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:24.501697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:24.510480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:24.511356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:24.511763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:24.512090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:24.512938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:24.513313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:24.514941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34107065-7ae1-4c6b-8b73-960327547d9f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:24.531194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 452/909] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:24.539665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:24.621059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:24.679410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa81775-76dc-46c3-be1f-b21c44377d36 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:24.726513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:24.727217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:24.727488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:24.727761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:24.728558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:24.730099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc90d-f646-4dea-b62b-600bcf90169e None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:24.767977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 458/910] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Oct 15 13:38:24 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:38:27.068172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540f82-f96c-4497-a866-280b649f3f28 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:27.068730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540f82-f96c-4497-a866-280b649f3f28 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:27.068730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540f82-f96c-4497-a866-280b649f3f28 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:27.070249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 453/911] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:27.075971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:27.076433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:27.076552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:27.096822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:27.098403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:27.188233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 459/912] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:27.452271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3540f82-f96c-4497-a866-280b649f3f28 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:27.568299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3540f82-f96c-4497-a866-280b649f3f28 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:27.606366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:27.607697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:27.607697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:27.607697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:27.619009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:38:27.623880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:27.624860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:27.625738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 454/913] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:27.631454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:27.678263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:27.763951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b68f01-0d88-4b81-8e01-92aced8544a8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:27.804859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:27.806112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:27.806112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:27.806112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:27.806644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] RBAC: Adding query filter params (name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:27.806942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:27.808535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:27.817906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 460/914] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:38:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:27.824044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:27.884607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:27.943672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac810e-6204-4a37-b878-5031e0f0e612 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:27.987559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:27.988221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:27.988723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:27.990313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.003305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.005446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:28.024411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:28.025671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:28.026779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:28.026779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:28.026779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:28.028432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 455/915] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:38:28.034536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:28.150881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:28.155166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227909a-218d-4eef-b838-6f64c8032e52 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:28.198992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:28.199669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:28.199985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:28.200254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.200908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:28.201210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.202575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:28.215896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 461/916] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:28.222571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:28.337821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb3697-3f28-4db0-8fb6-565672e2e996 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:28.339404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:28.376995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:28.377829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:28.378192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:28.378436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.387352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.388974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:38:28.402569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:28.403854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:28.406232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 456/917] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:28.411092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:28.527852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d408-d385-4fd4-9e70-251351e56391 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:28.575929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:28.577056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:28.577421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:28.577785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.578645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:28.579069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.580649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:28.603814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 462/918] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Oct 15 13:38:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:28.610177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:28.743741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eba0a0-344d-4fcf-bea6-5c45ee9932e0 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:28.782794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:28.783686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:28.784115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:28.784420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.798609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.800291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:28.817468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:28.823500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:28.824557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:28.824557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:28.824557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:28.824557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 457/919] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:28.824838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:28.853088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:28.948865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cdfe2-3da5-44b6-8a75-a3a3e85f2d7d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:28.985103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:28.985732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:28.985991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:28.986266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:28.986935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:28.987247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:28.988802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:29.006187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 463/920] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:29.008069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:29.029417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:29.135195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd21cf-90fc-4f7b-a59f-2684f14145a8 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:29.185572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:29.186246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:29.187136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:29.187136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:29.197309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:29.198997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:38:29.213368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:29.214397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:29.215465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:29.221342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 458/921] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:29.221576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:29.317132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:29.343369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f121-6b1e-439e-bfae-4685bff90702 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:29.384860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:29.385510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:29.385791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:29.386064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:29.386794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:29.387104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:29.388727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df1443-f729-4039-8205-ad7c9ebd2638 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:29.409365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 464/922] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:29.410794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:29.501535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:29.543368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd377fc4-0d97-4a89-8f30-dfd8f2a73c33 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:29.604565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:29.605320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:29.605665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:29.606055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/aef5b10788f64f30b4f45955e78b6618/roles/76606931d37b4a7a86ff03e7c248a8c9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:29.625779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=aef5b10788f64f30b4f45955e78b6618, role_id=76606931d37b4a7a86ff03e7c248a8c9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:29.627451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd47a-341d-4e97-9f4b-f3143d6c5c07 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:29.643060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 459/923] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:38:29 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/aef5b10788f64f30b4f45955e78b6618/roles/76606931d37b4a7a86ff03e7c248a8c9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:38:32.010622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861126-fc2e-44cb-8fcc-d0f9988897f1 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:32.011177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861126-fc2e-44cb-8fcc-d0f9988897f1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:32.011177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861126-fc2e-44cb-8fcc-d0f9988897f1 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:32.012844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 465/924] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:32.018464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:32.018916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:32.019006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:32.037751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:32.038959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:32.112012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 460/925] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:32.378690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74861126-fc2e-44cb-8fcc-d0f9988897f1 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:32.486755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74861126-fc2e-44cb-8fcc-d0f9988897f1 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:32.524019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:32.524675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:32.524951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:32.525226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:32.532782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:32.537570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:38:32.542639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:32.543661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:32.544724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 466/926] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Oct 15 13:38:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:32.550008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:32.615069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:32.661589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752fb9-41f4-40ca-a4f2-0119915aab61 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:32.699654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:32.700359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:32.700643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:32.700916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:32.701589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] RBAC: Adding query filter params (name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:32.701894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:32.703402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:32.715607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 461/927] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Oct 15 13:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:32.722327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:32.827020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d060125-2885-4864-bdef-fae1d48731f6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:32.862533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:32.863254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:32.863530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:32.863824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:32.874596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:32.876084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:32.890578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:32.891606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:32.892705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:32.892705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:32.892705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:32.892705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 467/928] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:32.897937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:33.005438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395a8d8-b648-4faf-a740-e3d7979ed879 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:33.022305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:33.041956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:33.042577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:33.042858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:33.043134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:33.043793 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:33.044132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:33.045496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:33.059009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 462/929] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:33.065634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:33.120036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:33.177041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc512-13cc-4d20-953e-078adc787fd6 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:33.213018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:33.213663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:33.213943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:33.214210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:33.222069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:33.223858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:38:33.235720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:33.236826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:33.237801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 468/930] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:33.243561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:33.349736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3b483-e84e-4314-b197-f42e33530f78 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:33.394482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:33.395581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:33.395915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:33.396171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:33.396900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:33.397203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:33.398635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:33.418876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 463/931] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Oct 15 13:38:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:33.425123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:33.539207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8b2db-ff4f-4b4c-9d90-b7670bfcaf90 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:33.549946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:33.578420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:33.578420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:33.578763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:33.579498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:33.667742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:33.669217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:33.797399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 469/932] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:38:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 15 13:38:33.804296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:33.842932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:33.919472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eaf60-c0ed-4772-9edf-f1e7f90e3ce9 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:33.959779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653772f2-e196-4023-a19e-af293c981891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:33.960486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653772f2-e196-4023-a19e-af293c981891 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:33.960762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653772f2-e196-4023-a19e-af293c981891 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:33.961031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653772f2-e196-4023-a19e-af293c981891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:33.972979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653772f2-e196-4023-a19e-af293c981891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:33.974770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653772f2-e196-4023-a19e-af293c981891 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-653772f2-e196-4023-a19e-af293c981891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:33.993120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:33.994469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:33.995575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:33.995575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:33.995575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:33.995575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 464/933] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:34.000663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:34.014170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:34.128075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b722b8-3f26-4294-a427-325cdfb3744b None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:34.171618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:34.172435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:34.172747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:34.173136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:34.173891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:34.174259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:34.176288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:34.192135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 470/934] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:34.198307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653772f2-e196-4023-a19e-af293c981891 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:34.306234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:34.327644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653772f2-e196-4023-a19e-af293c981891 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:34.365756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:34.366487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:34.366836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:34.367097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:34.374459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:34.376197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:38:34.388472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:34.389580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:34.390670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 465/935] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:34.396393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:34.480855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:34.515721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da090-1fb9-4700-bac8-c11afc774d6d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:34.552006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:34.552720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:34.553002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:34.553367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:34.554094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:34.554466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:34.556037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d48056-ab9c-4b14-9807-6e060983b9a5 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:34.570532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 471/936] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:34.577998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:34.688687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccadf61-0f3d-461b-b686-963169ad9902 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:34.733146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:34.733689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:34.733994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:34.734263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:34.735250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] RBAC: Adding query filter params (role.id=76606931d37b4a7a86ff03e7c248a8c9, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=aef5b10788f64f30b4f45955e78b6618) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:34.735485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:34.736976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3edd64-eea7-4e71-8053-1eb61cd63ddd None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:34.743463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 466/937] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:38:34 2022] GET /identity/v3/role_assignments?user.id=aef5b10788f64f30b4f45955e78b6618&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=76606931d37b4a7a86ff03e7c248a8c9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:37.075575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222950-66ea-433f-993a-14c7c1c6ba3c None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:37.076778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222950-66ea-433f-993a-14c7c1c6ba3c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:37.076778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222950-66ea-433f-993a-14c7c1c6ba3c None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:37.078410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 472/938] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:37.087132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:37.087711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:37.087711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:37.109215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:37.110603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:37.114752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:37.201777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 467/939] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:37.506227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222950-66ea-433f-993a-14c7c1c6ba3c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:37.668835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222950-66ea-433f-993a-14c7c1c6ba3c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:37.721444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:37.731495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:37.732518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:37.732933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:37.733378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:37.752088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:38:37.761028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:37.762215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:37.764173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 473/940] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:37.771517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:37.902769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c72ae8-ac19-4f87-b217-60792b9ee4be None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:37.973318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:37.974760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:37.975248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:37.975734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:37.977037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:37.977597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:37.980298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:37.997342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 468/941] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:38.005587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:38.162540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d69d-bbc2-4069-8511-8fa81892cd4a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:38.228574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:38.229457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:38.229905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:38.230346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:38.246849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:38.248962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:38.274124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:38.276045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:38.277692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:38.277692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:38.277692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:38.277692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 474/942] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:38:38.283151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:38.286813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:38.437940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43ffa-040b-4e80-b31a-a0e95fdadc6d None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:38.487314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:38.488254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:38.488634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:38.489072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:38.489837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:38.490229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:38.492276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:38.508216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 469/943] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:38.515018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:38.579464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:38.664333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eedbb-4cf8-4273-a6a6-1c87f91c3ede None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:38.724598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:38.725703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:38.726175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:38.726642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:38.742868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:38.744874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:38:38.761014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:38.763467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:38.765739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 475/944] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:38.773328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:38.860774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:38.917982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49fee4-5542-44cc-976a-f3c219ee5afb None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:38.965829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:38.966933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:38.967300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:38.967982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:38.969315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:38.969841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:38.972508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:38.998489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 470/945] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Oct 15 13:38:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:39.004892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:39.132082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42403d8b-5d0c-478e-8657-3f5e91ce7d4a None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:39.134166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:39.184590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:39.185549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:39.185815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:39.186226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:39.201464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:39.203115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:39.230131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:39.231451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:39.232772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:39.232772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:39.232772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:39.232772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 476/946] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:38:39.238921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:39.383721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69545b8-260a-4321-b397-d74bdf01c33b None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:39.419765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:39.443649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:39.444567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:39.444945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:39.445340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:39.446226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:39.446701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:39.448969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:39.466415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 471/947] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:39.476543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:39.634386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced16b6-01cf-400a-9fb0-a1d300c5f229 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:39.690986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:39.692136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:39.692624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:39.693117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:39.706562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:39.708656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:38:39.728334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:39.730609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:39.732844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 477/948] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:38:39.737722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:39.873743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05fe2-087b-470a-a953-d936af068e54 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:39.923218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:39.924002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:39.924339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:39.924664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:39.925657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:39.926019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:39.928566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47445c2-d115-4ebd-8052-8a38b5972ed5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:39.953771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 472/949] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:39.957117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:39.984866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:40.131908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532776-63cb-43c3-b57c-83238a7abcc4 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:40.193879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:40.194777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:40.195125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:40.195582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] PATH_INFO: `/v3/projects/f70202ac262c43f887223a279615a5ea/users/aef5b10788f64f30b4f45955e78b6618/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:40.198688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] RBAC: Authorizing `identity:create_grant(project_id=f70202ac262c43f887223a279615a5ea, user_id=aef5b10788f64f30b4f45955e78b6618, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:40.200830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006a797-87de-4a88-be2d-12d56de000ad None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:40.225220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 478/950] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Oct 15 13:38:39 2022] PUT /identity/v3/projects/f70202ac262c43f887223a279615a5ea/users/aef5b10788f64f30b4f45955e78b6618/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:38:42.774021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b718-f385-42f8-9cc0-4a48794c35f7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:42.775039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b718-f385-42f8-9cc0-4a48794c35f7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:42.775039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b718-f385-42f8-9cc0-4a48794c35f7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:42.777162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 473/951] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:42.784182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:42.784806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:42.784986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:42.810773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:42.812496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:42.930286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 479/952] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:43.229939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5b718-f385-42f8-9cc0-4a48794c35f7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:43.287435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:43.375465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5b718-f385-42f8-9cc0-4a48794c35f7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:43.431510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:43.432433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:43.432913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:43.433262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:43.448530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 15 13:38:43.453826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:43.455373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:43.457915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 474/953] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Oct 15 13:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:43.465200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:43.470457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:43.627587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f97849-2f4a-4f92-9720-f33ae18c3ef0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:43.676669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:43.677713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:43.678210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:43.678700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:43.680158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:43.680698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:43.683843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:43.702024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 480/954] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Oct 15 13:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:43.709881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:43.867488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:43.872657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39788a-dd05-43ba-ace3-13216590d396 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:43.926953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:43.928044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:43.928490 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:43.928926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:43.948939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:43.952211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:43.975136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:43.976458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:43.977409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:43.977409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:43.977409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:43.977409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 475/955] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:43.983587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:44.089371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:44.134627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b5c67-8142-4b5d-ade0-6da6220b90aa None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:44.177242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:44.177747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:44.177977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:44.178382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:44.179250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:44.179712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:44.181362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:44.197445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 481/956] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:44.207933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:44.350877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782845-989e-40e7-a877-79aba20a2688 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:44.387886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:44.388624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:44.388976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:44.389320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:44.398839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:44.400465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 15 13:38:44.413726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:44.414928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:44.415995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 476/957] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:44.423531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:44.556509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaed7d-e7da-4070-9033-609cac64f410 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:44.588451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:44.599956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:44.600592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:44.600881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:44.601136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:44.601892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:44.602196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:44.603707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:44.626119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 482/958] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Oct 15 13:38:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:44.633523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:44.653820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:44.778576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073385-9a25-42b8-b27a-86c01da53a6a None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:44.826786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:44.827401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:44.827643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:44.828133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:44.924695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:44.927154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:44.948780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:45.121831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 477/959] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Oct 15 13:38:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 15 13:38:45.132297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:45.308183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e28fdb-69d3-44f3-a0ed-824eef6101a8 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:45.361627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:45.362766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:45.363239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:45.363731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:45.377576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:45.379082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 15 13:38:45.397452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:45.399239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 15 13:38:45.400574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 15 13:38:45.400574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 13:38:45.400574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:45.405690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 483/960] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:45.406783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:45.571772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f0f8-7aaa-4f67-ae10-e8dc0a4d18f5 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:45.592781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:45.623542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:45.624275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:45.624614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:45.624903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:45.625662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:45.625970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:45.627538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:45.646516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 478/961] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Oct 15 13:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:45.647686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:45.692985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:45.778585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739fc1-7f56-416a-ac4a-e7f1533d25eb None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:45.820733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:45.821393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:45.821666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:45.821940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:45.829792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:45.831602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 15 13:38:45.845061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:45.846562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: ERROR keystone.server.flask.application Oct 15 13:38:45.848419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 484/962] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Oct 15 13:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 13:38:45.852716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:46.000357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259728-f463-49ce-ad0a-efeca00f1016 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:46.054905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:46.056337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:46.056829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:46.057276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:46.058520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:46.059067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:46.061776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768709ac-74a5-4a00-9a7a-129abadb0bc5 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:46.085275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 479/963] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Oct 15 13:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:46.093097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:46.260594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:46.270959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0f4d-29ba-47f2-871f-8b9cb91c2506 None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:46.328594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:46.329255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:46.329531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:46.329803 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:46.330587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] RBAC: Adding query filter params (role.id=19608e06d1c94b169326bd0a33985478, scope.project.id=f70202ac262c43f887223a279615a5ea, user.id=aef5b10788f64f30b4f45955e78b6618) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:46.330929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:46.332474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9416d-13cd-4b94-9669-e72039b900a6 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:46.340446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 485/964] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Oct 15 13:38:46 2022] GET /identity/v3/role_assignments?user.id=aef5b10788f64f30b4f45955e78b6618&scope.project.id=f70202ac262c43f887223a279615a5ea&role.id=19608e06d1c94b169326bd0a33985478 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:48.789958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db36b7-9cbc-432e-8da5-4af225250f86 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:48.790673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db36b7-9cbc-432e-8da5-4af225250f86 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:48.790673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db36b7-9cbc-432e-8da5-4af225250f86 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:48.791875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 480/965] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:48.799082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:48.799897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:48.799897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:48.819486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:48.820721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:48.901264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 486/966] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:49.214117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db36b7-9cbc-432e-8da5-4af225250f86 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:49.258071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:49.375707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db36b7-9cbc-432e-8da5-4af225250f86 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:49.427016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:49.428130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:49.428550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:49.429027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:49.429803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:49.431456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:49.441957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:49.443413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:49.444532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 481/967] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:38:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:49.449973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:49.551205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:49.562715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc9d7-c954-437b-8b3e-fb4072360676 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:49.602713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:49.603329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:49.603602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:49.603951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:49.604575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:49.604877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:49.606253 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67858282-e38b-4890-b9b1-3ebad163c8ca None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:49.611671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 487/968] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Oct 15 13:38:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:38:49.618383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:49.737072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:49.745201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25afb-9f97-4cd5-8c44-110535c4c66e None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:49.784817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:49.785457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:49.785732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:49.786000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] PATH_INFO: `/v3/services` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:49.786652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:49.786953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:49.788434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a99f-34af-49c9-b52e-a5b07be5c869 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:49.794061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 482/969] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Oct 15 13:38:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:52.151168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c0b6a-ede8-4615-a279-16f7e7e160ba None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:52.151815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c0b6a-ede8-4615-a279-16f7e7e160ba None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:52.151815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c0b6a-ede8-4615-a279-16f7e7e160ba None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:52.152978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 488/970] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:52.159198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c22-e3ef-459f-affc-098da65245c4 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:52.160210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c22-e3ef-459f-affc-098da65245c4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:52.160210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c22-e3ef-459f-affc-098da65245c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:52.182108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8f583c22-e3ef-459f-affc-098da65245c4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:52.183316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8f583c22-e3ef-459f-affc-098da65245c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:52.266700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 483/971] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:52.572993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c0b6a-ede8-4615-a279-16f7e7e160ba None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:52.685533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c0b6a-ede8-4615-a279-16f7e7e160ba None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:52.723719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:52.724436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:52.724690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:52.724937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:52.725665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:52.727199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cfc2b-63ec-4e83-8112-5490c2c0c252 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:52.745608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 489/972] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Oct 15 13:38:52 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:38:55.032556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550587b8-bbd0-4064-913e-6d363cfede0d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:55.033164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550587b8-bbd0-4064-913e-6d363cfede0d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:55.033164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550587b8-bbd0-4064-913e-6d363cfede0d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:55.034926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 484/973] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:55.040990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:55.041489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:55.041587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:55.061331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:55.062546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:55.074394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:55.149251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 490/974] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 15 13:38:55.421225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550587b8-bbd0-4064-913e-6d363cfede0d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:55.529882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:55.541169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550587b8-bbd0-4064-913e-6d363cfede0d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:55.577469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:55.578120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:55.578398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:55.578666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] PATH_INFO: `/v3/services/placement` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:55.579250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:55.580886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:55.590269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:55.591523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:55.592753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 485/975] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:38:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:55.597839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:55.722022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37daa6-7f56-44fb-83cb-43c1a9b36103 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:55.760198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:55.760839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:55.761123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:55.761399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:55.762054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:55.762358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:55.763756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:55.770125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 491/976] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Oct 15 13:38:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:55.776961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:55.889684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbcdd5-487a-4ee2-b954-4ec77f8d016f None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:55.931017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:55.932022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:55.932494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:55.932809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:55.933531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] RBAC: Adding query filter params (interface=public, service_id=583ab8bc9d2d4e909b9b687326d1bec9, region_id=RegionOne) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:55.933853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:55.935252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9669-c8a1-4ee2-8c0e-802cd5e29fb6 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:55.941140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 486/977] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Oct 15 13:38:55 2022] GET /identity/v3/endpoints?service_id=583ab8bc9d2d4e909b9b687326d1bec9&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:55.947293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:55.951215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:56.066943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e273-6082-44fe-b54c-b94c4872772d None admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:56.104165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:56.104790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:56.105066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:56.105337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:56.105950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:56.107321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb689b4-a06e-4209-bb52-3192bc0806b7 None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:56.114892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 492/978] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Oct 15 13:38:55 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:38:58.376016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5903f-4b67-443f-b70d-6434a4027615 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:58.376635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5903f-4b67-443f-b70d-6434a4027615 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:58.376635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5903f-4b67-443f-b70d-6434a4027615 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:58.378353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 487/979] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:38:58.384061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:58.384506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:58.384644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:58.406514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:38:58.408009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:38:58.486838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:58.494529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 493/980] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:38:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 15 13:38:58.768497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5903f-4b67-443f-b70d-6434a4027615 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:58.790166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:58.883663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5903f-4b67-443f-b70d-6434a4027615 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:58.920887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:58.921533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:58.921820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:58.922088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:58.922672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:58.924126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 15 13:38:58.933337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 15 13:38:58.934561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.get_or_create( Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application with Lock( Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self._enter() Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application return self.creator() Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application created_value = creator( Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: ERROR keystone.server.flask.application Oct 15 13:38:58.935912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 488/981] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Oct 15 13:38:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 13:38:58.942096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:59.063510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074573cc-6cc9-41da-a546-9407a5e647fa None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:59.104701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:59.105338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:59.105612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:59.105880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] PATH_INFO: `/v3/services` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:59.106544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:38:59.106885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:59.108351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cad05-4e80-45ae-a0fc-e164c4e0564b None admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:59.114663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 494/982] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Oct 15 13:38:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:38:59.121001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:38:59.224441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:38:59.254058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928f274-44fb-487d-b0fc-2944258c09d2 None admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:38:59.298611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:38:59.299227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:38:59.299504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:38:59.299765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:38:59.300483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:38:59.301879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164b2b3-8cda-466a-aba6-39227133c500 None admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:38:59.325591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 489/983] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:38:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:39:09.111996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=69 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:39:09.320577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:07.424627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ab32-f8bc-4f2e-8754-5367e1e59de9 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:07.425102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ab32-f8bc-4f2e-8754-5367e1e59de9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:07.425177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ab32-f8bc-4f2e-8754-5367e1e59de9 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:07.430792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 495/984] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:07.432287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74d3-806c-4740-840c-920f185aae11 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:07.433064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74d3-806c-4740-840c-920f185aae11 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:07.433179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74d3-806c-4740-840c-920f185aae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:07.533484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b9bc74d3-806c-4740-840c-920f185aae11 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:07.534614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b9bc74d3-806c-4740-840c-920f185aae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:07.654280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 490/985] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:07.956329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:07.956586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:07.956868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:07.958480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 496/986] 10.222.0.33 () {54 vars in 964 bytes} [Sat Oct 15 13:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:07.964816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789006-2ff2-4967-a811-9b96cab8ea77 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:07.965149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789006-2ff2-4967-a811-9b96cab8ea77 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:07.965455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789006-2ff2-4967-a811-9b96cab8ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:08.052368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3b789006-2ff2-4967-a811-9b96cab8ea77 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:08.053798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3b789006-2ff2-4967-a811-9b96cab8ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:08.077853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:08.139043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 491/987] 10.222.0.33 () {58 vars in 1061 bytes} [Sat Oct 15 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:08.148170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:08.150024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:08.269840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326a0fc-e0ba-4dec-9a0f-8eb94137ef2a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:08.358856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:08.359679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:08.360005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:08.360584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:08.362302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:08.422925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:08.485771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:08.487391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c66d67-7661-434a-9bbb-0a7133708ed6 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:08.515274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 497/988] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:11.082821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:11.083339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:11.083339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:11.084823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 492/989] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:11.091917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae892-511c-40a8-a982-a8130c7886b1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:11.092392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae892-511c-40a8-a982-a8130c7886b1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:11.092481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae892-511c-40a8-a982-a8130c7886b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:11.189624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f6cae892-511c-40a8-a982-a8130c7886b1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:11.190855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f6cae892-511c-40a8-a982-a8130c7886b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:11.317408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 498/990] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:11.598406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:11.600009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:11.714996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c511-7c6f-4bef-b36d-851795f931bf None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:11.791167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:11.794599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:11.795299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:11.795845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:11.796249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:11.798517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:11.914927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:11.916360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88332c8-5ee3-4f8b-a98b-c9ac7393c214 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:11.936063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 493/991] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:14.469948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020316e-a2e1-46d7-80fb-fb1d1adb0296 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:14.470546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020316e-a2e1-46d7-80fb-fb1d1adb0296 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:14.470546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020316e-a2e1-46d7-80fb-fb1d1adb0296 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:14.472570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 499/992] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:14.478401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0463-9b09-4cac-8102-56e64e6a8774 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:14.478857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0463-9b09-4cac-8102-56e64e6a8774 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:14.478974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0463-9b09-4cac-8102-56e64e6a8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:14.558072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f3da0463-9b09-4cac-8102-56e64e6a8774 None None] MFA Rules not processed for user `2b56edddce3246039f31f9e14efa657e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:14.559353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f3da0463-9b09-4cac-8102-56e64e6a8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:14.614427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:14.663457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 494/993] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:14.966103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:14.966372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:14.967210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:14.968030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 500/994] 10.222.0.33 () {54 vars in 964 bytes} [Sat Oct 15 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:14.974397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9694-2947-4b27-ab2f-afe2bacb42c7 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:14.974676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9694-2947-4b27-ab2f-afe2bacb42c7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:14.974952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9694-2947-4b27-ab2f-afe2bacb42c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:15.060753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-599e9694-2947-4b27-ab2f-afe2bacb42c7 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:15.061998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-599e9694-2947-4b27-ab2f-afe2bacb42c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:15.144453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 495/995] 10.222.0.33 () {58 vars in 1061 bytes} [Sat Oct 15 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:15.153861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:15.155435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:15.165779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:15.272354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aaa58-c73b-4ff0-bfd5-bca9f508bf50 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:15.358368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:15.358988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:15.359265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:15.359544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:15.361226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:15.445013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:15.502815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:15.504316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cab56-83fc-4d80-befb-aca11044cc74 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:15.524866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 501/996] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:18.769101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:18.769737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:18.769737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:18.771026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 496/997] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:18.777062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553869-3b27-4f09-b29f-fc30198a697f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:18.777622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553869-3b27-4f09-b29f-fc30198a697f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:18.777622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553869-3b27-4f09-b29f-fc30198a697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:18.850083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ba553869-3b27-4f09-b29f-fc30198a697f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:18.851310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ba553869-3b27-4f09-b29f-fc30198a697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:18.975576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 502/998] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:19.269564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:19.271167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:19.325799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:19.386181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbf210-82cd-4d91-88aa-c7cadf03728e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:19.471756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:19.472540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:19.472951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:19.473351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:19.475293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:19.590168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:19.605447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:19.607022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a31d-4e3d-4cde-a023-9e383fe3e64e service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:19.628282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 497/999] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:23.041340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:23.042122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:23.042422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:23.044749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 503/1000] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:23.052412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22272-1656-4716-a08e-4258593f610a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:23.053046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22272-1656-4716-a08e-4258593f610a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:23.053046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22272-1656-4716-a08e-4258593f610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:23.136147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-49c22272-1656-4716-a08e-4258593f610a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:23.140433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-49c22272-1656-4716-a08e-4258593f610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:23.266484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 498/1001] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:23.554498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:23.556931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:23.579746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:23.680128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48150e-ecc6-4fda-8dfa-ef24f7100c6d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:23.770763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:23.771579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:23.771992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:23.772358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:23.774235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:23.863916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:23.916473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:23.918215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a9269-9fd3-4cc7-a73d-3d75a87f3773 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:23.940502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 504/1002] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:26.384557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:26.385432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:26.385591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:26.388358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 499/1003] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:26.399379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf92f7-1488-4b03-bfe9-0314231c8694 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:26.400041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf92f7-1488-4b03-bfe9-0314231c8694 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:26.400367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf92f7-1488-4b03-bfe9-0314231c8694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:26.513026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f0bf92f7-1488-4b03-bfe9-0314231c8694 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:26.514387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f0bf92f7-1488-4b03-bfe9-0314231c8694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:26.699188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 505/1004] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:26.987838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:26.990827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:27.108918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:27.167158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b302a-f89d-48f9-be1c-e19bf0984b43 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:27.255601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:27.256270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:27.256606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:27.256931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:27.258747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:27.386566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:27.389532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:27.391128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486884-019f-42b7-9a61-c3bbc5438eda service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:27.412405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 500/1005] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:29.764190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:29.764745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:29.764745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:29.766069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 506/1006] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:40:29.772128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda796-543c-446a-8486-f76754d46035 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:29.772576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda796-543c-446a-8486-f76754d46035 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:29.772699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda796-543c-446a-8486-f76754d46035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:29.854062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-34fda796-543c-446a-8486-f76754d46035 None None] MFA Rules not processed for user `2b56edddce3246039f31f9e14efa657e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:29.855437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-34fda796-543c-446a-8486-f76754d46035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:29.957668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 501/1007] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:30.241070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:30.242665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:30.279550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:30.364596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3e5d-c0bf-457e-b70c-39c94d2ecb61 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:30.450607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:30.451250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:30.451525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:30.451835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:30.453721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:30.552543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:30.589467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:30.590940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c8e27-56eb-42a9-a6a6-8257b765b419 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:30.611119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 507/1008] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:33.065639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:33.066184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:33.066184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:33.067551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 502/1009] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:33.073436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ce11-7310-4157-910a-61eb1916c3bb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:33.074005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ce11-7310-4157-910a-61eb1916c3bb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:33.074005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ce11-7310-4157-910a-61eb1916c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:33.145832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1eb3ce11-7310-4157-910a-61eb1916c3bb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:33.147075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1eb3ce11-7310-4157-910a-61eb1916c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:33.250239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 508/1010] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:33.528962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:33.530651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:33.611878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:33.650644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59f18-c552-4e4d-b0fe-d6d273a43bb2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:33.730069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:33.730679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:33.730953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:33.731220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:33.732870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:33.847454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:33.848821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6ea5f-37de-4d9d-b026-f9e1991c1567 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:33.859051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:33.868659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 503/1011] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:36.124615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:36.125175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:36.125175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:36.126436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 509/1012] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:36.132205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7762-fb21-4a09-bdf2-9337cd67c9d5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:36.132675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7762-fb21-4a09-bdf2-9337cd67c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:36.132778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7762-fb21-4a09-bdf2-9337cd67c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:36.206250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-49ea7762-fb21-4a09-bdf2-9337cd67c9d5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:36.207486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-49ea7762-fb21-4a09-bdf2-9337cd67c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:36.307813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 504/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:36.591817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:36.593385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:36.642508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:36.710126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b3375-fb13-4650-9478-3836ec5e3cca None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:36.791937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:36.792558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:36.792838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:36.793111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:36.794740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:36.888124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:36.919395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:36.920910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a1e7-11ec-4254-babc-a8b469fd3e72 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:36.941891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 510/1014] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:39.470811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:39.471383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:39.471383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:39.472741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 505/1015] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:39.479218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fc02-e170-4585-8f58-9810c950513f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:39.479738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fc02-e170-4585-8f58-9810c950513f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:39.480140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fc02-e170-4585-8f58-9810c950513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:39.551768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ab15fc02-e170-4585-8f58-9810c950513f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:39.553001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ab15fc02-e170-4585-8f58-9810c950513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:39.657263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 511/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:40:39.937370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:39.938913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:40.018543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:40.049675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e968-ee43-4605-a4a0-9d756172749d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:40.129934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:40.130564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:40.130842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:40.131112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:40.132770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:40.261242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:40.262635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94396d7-e2e8-4f4a-b939-a1f605ca0863 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:40.283011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 506/1017] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:44.606090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:44.606649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:44.606649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:44.608095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 512/1018] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:44.614057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48553-e2ab-4863-804f-0805e44feb78 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:44.614593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48553-e2ab-4863-804f-0805e44feb78 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:44.614735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d48553-e2ab-4863-804f-0805e44feb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:44.620655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:44.694710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c2d48553-e2ab-4863-804f-0805e44feb78 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:44.695990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c2d48553-e2ab-4863-804f-0805e44feb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:44.815492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 507/1019] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:45.095202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:45.096957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:45.156362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:45.229957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0ac3-d095-4e1c-9ec9-d133b3f37c7f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:45.312548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:45.313078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:45.313358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:45.313625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:45.315274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:45.416517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:45.440340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:45.441800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84089a2-ae23-478a-8ddf-44235cd80b31 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:45.463525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 513/1020] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:48.351592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:48.352205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:48.352546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:48.354875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 508/1021] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:48.360876 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd3f3-6fb0-44ae-a791-937b66855b3a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:48.361411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd3f3-6fb0-44ae-a791-937b66855b3a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:48.361411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd3f3-6fb0-44ae-a791-937b66855b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:48.436780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-40abd3f3-6fb0-44ae-a791-937b66855b3a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:48.438040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-40abd3f3-6fb0-44ae-a791-937b66855b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:48.543291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 514/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:40:48.831638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:48.833347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:48.931897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:48.952627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f8e58-272c-4048-a332-9c66dad1523d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:49.037379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:49.037998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:49.038270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:49.038540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:49.040235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:49.156342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:49.157916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27288-9f2c-4650-8dd3-d35e76a7eca9 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:49.180210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 509/1023] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:53.529691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382749-1269-4552-b34a-65701849ba1a None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:53.530396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382749-1269-4552-b34a-65701849ba1a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:53.530396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382749-1269-4552-b34a-65701849ba1a None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:53.531759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 515/1024] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:53.537264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4c3-4735-4ff9-ae7c-0261b1e09df9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:53.537740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4c3-4735-4ff9-ae7c-0261b1e09df9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:53.537867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4c3-4735-4ff9-ae7c-0261b1e09df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:53.555606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:53.613430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b8f8c4c3-4735-4ff9-ae7c-0261b1e09df9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:53.614655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b8f8c4c3-4735-4ff9-ae7c-0261b1e09df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:53.726003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 510/1025] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:40:54.004219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382749-1269-4552-b34a-65701849ba1a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:40:54.005780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6a382749-1269-4552-b34a-65701849ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:54.071306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:54.124287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382749-1269-4552-b34a-65701849ba1a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:40:54.206383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:40:54.206993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:54.207258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:54.207558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:54.209226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:54.328727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:40:54.333615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:40:54.335388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98abdf9-3dcd-460f-96b7-36609ce38625 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:40:54.354820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 516/1026] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:40:59.410596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcc02-aa7d-4b9e-8a7c-911981e2306d None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:59.411003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcc02-aa7d-4b9e-8a7c-911981e2306d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:59.411003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcc02-aa7d-4b9e-8a7c-911981e2306d None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:59.412880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 511/1027] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:40:59.419263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3439430-2f41-494f-ae64-90725980df42 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:40:59.419854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3439430-2f41-494f-ae64-90725980df42 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:40:59.419854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3439430-2f41-494f-ae64-90725980df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:40:59.553709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a3439430-2f41-494f-ae64-90725980df42 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:40:59.554966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a3439430-2f41-494f-ae64-90725980df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:40:59.699702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 517/1028] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:03.724212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=59 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:04.324806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4f44-41c2-4ea2-9623-e9f0eda65f02 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:04.325113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4f44-41c2-4ea2-9623-e9f0eda65f02 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:04.325617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4f44-41c2-4ea2-9623-e9f0eda65f02 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:04.327155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 512/1029] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:04.334029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac9f33-47a7-4d9e-a103-00e8637a9fe3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:04.334607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac9f33-47a7-4d9e-a103-00e8637a9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:04.335121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac9f33-47a7-4d9e-a103-00e8637a9fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:04.414260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:04.445523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5eac9f33-47a7-4d9e-a103-00e8637a9fe3 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:04.446933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5eac9f33-47a7-4d9e-a103-00e8637a9fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:04.581554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 518/1030] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:05.921753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1d23-99b0-4fb3-957a-fa19aa123be8 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:05.922327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1d23-99b0-4fb3-957a-fa19aa123be8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:05.922425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1d23-99b0-4fb3-957a-fa19aa123be8 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:05.923893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 513/1031] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:05.930072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a4b4-e04a-4526-a99a-a258cccb3f27 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:05.930604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a4b4-e04a-4526-a99a-a258cccb3f27 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:05.930604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a4b4-e04a-4526-a99a-a258cccb3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:06.017691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0e33a4b4-e04a-4526-a99a-a258cccb3f27 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:06.018805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0e33a4b4-e04a-4526-a99a-a258cccb3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:06.067007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:06.138702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 519/1032] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:41:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:09.834341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5debb-205a-449d-8779-26041eb76123 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:09.835307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5debb-205a-449d-8779-26041eb76123 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:09.835307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5debb-205a-449d-8779-26041eb76123 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:09.840026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 514/1033] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:09.844602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96022cd-db05-4d2b-9cfd-feab63e4825b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:09.845388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96022cd-db05-4d2b-9cfd-feab63e4825b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:09.845565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96022cd-db05-4d2b-9cfd-feab63e4825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:09.990413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c96022cd-db05-4d2b-9cfd-feab63e4825b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:09.992207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c96022cd-db05-4d2b-9cfd-feab63e4825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:10.159631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 520/1034] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:10.464703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:10.465374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:10.466046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:10.469453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 515/1035] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:41:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:10.478851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00bad-8557-4aa4-b038-61c65ddf574d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:10.480146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00bad-8557-4aa4-b038-61c65ddf574d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:10.480679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00bad-8557-4aa4-b038-61c65ddf574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:10.502700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:10.577914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-dae00bad-8557-4aa4-b038-61c65ddf574d None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:10.579413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-dae00bad-8557-4aa4-b038-61c65ddf574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:10.726442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 521/1036] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:10.734551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:10.736864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:10.925080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a863de-5f3b-45f5-8b7c-51780895dcea None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:11.032437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:11.126082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:11.127101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:11.127584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:11.128095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:11.131197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:11.264763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:11.266575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fadbda-e31f-4ef2-b511-f65d414b454b service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:11.289099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 516/1037] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:13.800699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:13.801248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:13.801248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:13.803102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 522/1038] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:13.809402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74f2f-1913-4403-80b9-32c54b411c1e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:13.809997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74f2f-1913-4403-80b9-32c54b411c1e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:13.809997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74f2f-1913-4403-80b9-32c54b411c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:13.894650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2df74f2f-1913-4403-80b9-32c54b411c1e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:13.895832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2df74f2f-1913-4403-80b9-32c54b411c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:13.947496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:14.033798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 517/1039] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:14.327405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:14.329089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:14.415551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:14.513531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04dc79-f63b-470c-b0ae-2172fe0ab6e2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:14.650345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:14.650987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:14.651273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:14.651548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:14.653277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:14.681765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:14.763821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:14.765452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc750-04d8-4eca-83da-e205218e0cfc service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:14.786103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 523/1040] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:17.574054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b4a7-a698-43ac-b375-da09416bcba3 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:17.574972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b4a7-a698-43ac-b375-da09416bcba3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:17.574972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b4a7-a698-43ac-b375-da09416bcba3 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:17.576514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 518/1041] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:41:17.582462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e527e6-cded-43ab-a6d5-4db09f4c147e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:17.583247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e527e6-cded-43ab-a6d5-4db09f4c147e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:17.583247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e527e6-cded-43ab-a6d5-4db09f4c147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:17.663858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b1e527e6-cded-43ab-a6d5-4db09f4c147e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:17.665114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b1e527e6-cded-43ab-a6d5-4db09f4c147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:17.790878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:17.803366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 524/1042] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:18.095751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef6c8-8381-4bf9-a6f8-af6da7564073 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:18.096097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef6c8-8381-4bf9-a6f8-af6da7564073 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:18.096366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef6c8-8381-4bf9-a6f8-af6da7564073 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:18.098077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 519/1043] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:18.104568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:18.104886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:18.105229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:18.226835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:18.229061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:18.465875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210b7d-418d-42e7-b7ee-1ab4cb15861b None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:18.466208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210b7d-418d-42e7-b7ee-1ab4cb15861b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:18.466610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210b7d-418d-42e7-b7ee-1ab4cb15861b None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:18.468106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 520/1044] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:41:18.473692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce9b8-1258-4405-b4b7-35bcb24ad6bc None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:18.473983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce9b8-1258-4405-b4b7-35bcb24ad6bc None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:18.474234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce9b8-1258-4405-b4b7-35bcb24ad6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:18.496377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 525/1045] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:18.506418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:18.526771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025e56-9343-43f3-8a58-b66c66ea4bdd None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:18.562408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-935ce9b8-1258-4405-b4b7-35bcb24ad6bc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:18.563808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-935ce9b8-1258-4405-b4b7-35bcb24ad6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:18.621821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:18.727266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 521/1046] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:18.792576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:18.793848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:18.794338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:18.794825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:18.798294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:18.985933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:18.989014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e04a-ef35-4ec6-aa55-98a0d367177c service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:19.026823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 526/1047] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:41:19.067302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:19.067302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:19.067302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:19.067302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 522/1048] 10.222.0.33 () {54 vars in 963 bytes} [Sat Oct 15 13:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:41:19.077730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2165-b1e4-456f-b0a5-fda179f2251e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:19.077730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2165-b1e4-456f-b0a5-fda179f2251e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:19.077730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2165-b1e4-456f-b0a5-fda179f2251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:19.175908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:19.227173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d13a2165-b1e4-456f-b0a5-fda179f2251e None None] MFA Rules not processed for user `4fb1ad7b1aec4c5f99b1341e62d18c04`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:19.232981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d13a2165-b1e4-456f-b0a5-fda179f2251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:19.420045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 527/1049] 10.222.0.33 () {58 vars in 1060 bytes} [Sat Oct 15 13:41:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:19.430909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:19.434263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:19.477931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:19.704755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885829-29d4-41f8-b13e-7ee6172f5e34 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:19.926332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:19.928411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:19.929392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:19.929845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:19.932120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:20.041788 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:20.093498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:20.097503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec8eb-15a2-4dcf-8e39-dc764a0cab19 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:20.122383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 523/1050] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:21.419840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:21.420703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:21.420703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:21.421678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 528/1051] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:21.431959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5307528-0bd4-4c3f-9215-20aac190aedd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:21.432538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5307528-0bd4-4c3f-9215-20aac190aedd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:21.432941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5307528-0bd4-4c3f-9215-20aac190aedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:21.530942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f5307528-0bd4-4c3f-9215-20aac190aedd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:21.532232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f5307528-0bd4-4c3f-9215-20aac190aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:21.660029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 524/1052] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:21.965956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:21.968030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:22.169723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:22.179277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf97b-d2aa-470d-9661-88f34b172be0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:22.354898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:22.355898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:22.356282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:22.356658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:22.358585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:22.497787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:22.500116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ae1d-9ded-4ab6-a863-e5b88fb5b5f5 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:22.524463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:22.528034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 529/1053] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:41:24.873621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:24.874205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:24.874533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:24.876964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 525/1054] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:24.882385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbd9ff-afa6-43e9-b3f5-36532beea93e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:24.882910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbd9ff-afa6-43e9-b3f5-36532beea93e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:24.882910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbd9ff-afa6-43e9-b3f5-36532beea93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:24.958435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d8cbd9ff-afa6-43e9-b3f5-36532beea93e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:24.959693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d8cbd9ff-afa6-43e9-b3f5-36532beea93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:25.076850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 530/1055] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:25.372429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:25.374235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:25.415380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:25.548692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a1533-446b-4e5e-a1b0-acc9c7bef822 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:25.662576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:25.675838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:25.676823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:25.677099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:25.677356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:25.679141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:25.790447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:25.792465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7d5c-a6d4-4e97-96cb-a04094cf4be0 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:25.813105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 526/1056] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:28.096905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:28.097512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:28.097620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:28.098919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 531/1057] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:28.105178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf61fc-7529-4112-9e5a-1e5bf12d977d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:28.106055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf61fc-7529-4112-9e5a-1e5bf12d977d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:28.106484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf61fc-7529-4112-9e5a-1e5bf12d977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:28.199341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c6bf61fc-7529-4112-9e5a-1e5bf12d977d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:28.201402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c6bf61fc-7529-4112-9e5a-1e5bf12d977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:28.308651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:28.376461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 527/1058] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:28.684377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:28.686178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:28.807278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:28.910995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7987-c426-44e1-95ac-389b17376e6e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:29.079814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:29.080458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:29.080746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:29.081029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:29.082748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:29.152115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:29.231589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:29.234380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdab5-c79e-495f-8d49-e4b586454e4d service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:29.268766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 532/1059] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:32.096041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:32.096940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:32.096940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:32.099227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 528/1060] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:32.106800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374b29-6651-48f8-97e5-48278bde09c1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:32.107725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374b29-6651-48f8-97e5-48278bde09c1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:32.107725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374b29-6651-48f8-97e5-48278bde09c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:32.194929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bf374b29-6651-48f8-97e5-48278bde09c1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:32.196284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bf374b29-6651-48f8-97e5-48278bde09c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:32.322910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 533/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:32.656562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:32.658259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:32.907011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a465b-264f-4db9-9ce6-80575e70e5c7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:33.000584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:33.118708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:33.119655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:33.120077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:33.120521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:33.122784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:33.311214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:33.314881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a868f-e80a-4d7f-9893-e65b3a292835 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:33.359584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 529/1062] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:36.076122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35962e1-1438-4bf3-955d-b46c248f1d7e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.076743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35962e1-1438-4bf3-955d-b46c248f1d7e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.076743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35962e1-1438-4bf3-955d-b46c248f1d7e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.077997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 534/1063] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:36.084105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16176-b586-4edd-975b-964c1d5046df None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.084673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16176-b586-4edd-975b-964c1d5046df None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.084673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16176-b586-4edd-975b-964c1d5046df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.158498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-82a16176-b586-4edd-975b-964c1d5046df None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:36.159754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-82a16176-b586-4edd-975b-964c1d5046df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:36.162355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:36.274553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 530/1064] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:36.289652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.290087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.290445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.291939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 535/1065] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:36.297649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab9e-dc6f-4002-86a2-cd775ff00e0f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.297931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab9e-dc6f-4002-86a2-cd775ff00e0f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.298192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab9e-dc6f-4002-86a2-cd775ff00e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.377767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-914aab9e-dc6f-4002-86a2-cd775ff00e0f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:36.378923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-914aab9e-dc6f-4002-86a2-cd775ff00e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:36.491911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:36.518068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 531/1066] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:36.584589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:36.586243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:36.612599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:36.789502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f9ea-fe82-436d-9cde-58111fe26147 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:36.844209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c279-cfcf-462f-abbb-1a711bd43638 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.844616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c279-cfcf-462f-abbb-1a711bd43638 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.844962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c279-cfcf-462f-abbb-1a711bd43638 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.846508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 532/1067] 10.222.0.33 () {54 vars in 962 bytes} [Sat Oct 15 13:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:41:36.852695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.853083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.853433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.907515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:36.933772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:36.934556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:36.935258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:36.935704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:36.937409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:36.953735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] MFA Rules not processed for user `5f309ff57750472c9011ccf17eb7089e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:36.954975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:37.039940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 533/1068] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Oct 15 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:37.041746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:37.043543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6de80-b178-4082-913b-b9b001041966 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:37.049578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:37.058343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec1ef-600e-4923-9a15-c893d83b9062 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:37.065791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 536/1069] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:37.148202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:37.158842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:37.159607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:37.159927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:37.160221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:37.162112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:37.306239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:37.307721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1152e8-7243-4a61-8be7-78820b31fd9d service glance] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:37.330722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 534/1070] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:41:38.141710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d273b-d786-4f95-b891-0abfb3dd8ad6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:38.142276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d273b-d786-4f95-b891-0abfb3dd8ad6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:38.142522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d273b-d786-4f95-b891-0abfb3dd8ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:38.234663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7d0d273b-d786-4f95-b891-0abfb3dd8ad6 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:38.237076 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7d0d273b-d786-4f95-b891-0abfb3dd8ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:38.332568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:38.396778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 537/1071] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:41:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:38.449421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:38.450019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:38.450019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:38.451317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 535/1072] 10.222.0.33 () {54 vars in 943 bytes} [Sat Oct 15 13:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:38.458276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c4d6-94ff-43df-ab69-7007d88cfa38 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:38.458787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c4d6-94ff-43df-ab69-7007d88cfa38 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:38.458940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c4d6-94ff-43df-ab69-7007d88cfa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:38.545993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7259c4d6-94ff-43df-ab69-7007d88cfa38 None None] MFA Rules not processed for user `ecc00888b1344a4fbc4fb5fd383791ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:38.547355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7259c4d6-94ff-43df-ab69-7007d88cfa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:38.663017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 538/1073] 10.222.0.33 () {58 vars in 1040 bytes} [Sat Oct 15 13:41:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:38.672696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:38.674323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:38.797421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:38.846640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fa3ff-8593-4483-aefd-bebce5d9f834 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:38.985993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:38.987033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:38.987530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:38.988045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:38.991271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:39.109148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:39.110868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579bff-75e0-4a55-9d12-1d650fb227f3 service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:39.116653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:39.122035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 536/1074] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:41:39.403917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:39.404552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:39.404552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:39.406144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 539/1075] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:39.414318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5d33-e316-4a95-87e8-21d99e70a60a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:39.414637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5d33-e316-4a95-87e8-21d99e70a60a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:39.414784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5d33-e316-4a95-87e8-21d99e70a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:39.524999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-25fc5d33-e316-4a95-87e8-21d99e70a60a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:39.528488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-25fc5d33-e316-4a95-87e8-21d99e70a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:39.721053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 537/1076] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:40.025899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:40.027440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:40.070016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:40.260938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b536d-b9fb-4dee-a9d0-467484607950 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:40.372099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:40.384663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:40.385510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:40.385737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:40.386063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:40.387774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:40.498879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:40.500573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02991c-e960-473c-957e-822ba399c1d7 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:40.522502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 540/1077] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:42.943660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:42.944282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:42.944282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:42.947650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 538/1078] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:42.951616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7ad9-10ce-48ae-85ee-fdd081f9abc4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:42.952283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7ad9-10ce-48ae-85ee-fdd081f9abc4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:42.952283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7ad9-10ce-48ae-85ee-fdd081f9abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:43.032148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7cfc7ad9-10ce-48ae-85ee-fdd081f9abc4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:43.033627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7cfc7ad9-10ce-48ae-85ee-fdd081f9abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:43.115102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:43.190428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 541/1079] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:43.485491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:43.487061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:43.586635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:43.704070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63beb1b0-57f7-4f90-8660-260cb3308bc9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:43.853178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:43.853717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:43.853993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:43.854263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:43.855952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:43.903769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:43.964152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:43.965950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa3485-afe1-41ab-bbe4-98c656dea6ee service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:43.990250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 539/1080] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:41:46.551745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:46.552990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:46.552990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:46.555319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 542/1081] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:41:46.563979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041d1b5-5aaf-4812-9d5a-6a4872f1cbdb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:46.564854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041d1b5-5aaf-4812-9d5a-6a4872f1cbdb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:46.564854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041d1b5-5aaf-4812-9d5a-6a4872f1cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:46.676042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4041d1b5-5aaf-4812-9d5a-6a4872f1cbdb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:46.678542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4041d1b5-5aaf-4812-9d5a-6a4872f1cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:46.859049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 540/1082] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:41:47.160116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:47.162689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:47.376625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a70a41-6ec7-48ec-ac6c-62e7fe36edbb None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:47.457086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:47.563534 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:47.565312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:47.565312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:47.565312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:47.568350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:47.732850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:47.736549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3273c-0b44-4b9d-a0cf-55b72ca295ce service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:47.778658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 543/1083] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:41:50.145905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:50.146471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:50.146471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:50.148105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 541/1084] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:41:50.153976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815ad4-4153-4a18-a744-606d45436d9d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:50.154517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815ad4-4153-4a18-a744-606d45436d9d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:50.154517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815ad4-4153-4a18-a744-606d45436d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:50.245138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-43815ad4-4153-4a18-a744-606d45436d9d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:41:50.246683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-43815ad4-4153-4a18-a744-606d45436d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:50.248994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:50.382474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 544/1085] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:41:50.717186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:41:50.724238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:50.763900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:50.956929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bec924-1d47-4876-9ba2-654c56326a71 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:41:51.099053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:51.128710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:41:51.129356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:41:51.129636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:41:51.129905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:41:51.131686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:41:51.269626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:41:51.272180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03001bf5-77d2-4f3c-97ff-5608b2ed5337 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:41:51.305982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 542/1086] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:00.372853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=42 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:01.301983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=54 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:03.107542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e224e-5954-4941-96cf-0f719cf4d8a9 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:03.108222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e224e-5954-4941-96cf-0f719cf4d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:03.108222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e224e-5954-4941-96cf-0f719cf4d8a9 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:03.109491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 545/1087] 10.222.0.33 () {54 vars in 918 bytes} [Sat Oct 15 13:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:03.124010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6883-af2c-49f2-94d3-f419c30df53a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:03.124609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6883-af2c-49f2-94d3-f419c30df53a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:03.124916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6883-af2c-49f2-94d3-f419c30df53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:03.230371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-1dab6883-af2c-49f2-94d3-f419c30df53a None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:03.231611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1dab6883-af2c-49f2-94d3-f419c30df53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:03.363040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 543/1088] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Oct 15 13:42:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:03.381598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c84e0-2a27-4c8b-94b0-0c5301037031 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:03.381903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c84e0-2a27-4c8b-94b0-0c5301037031 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:03.382202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c84e0-2a27-4c8b-94b0-0c5301037031 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:03.383682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 546/1089] 10.222.0.33 () {54 vars in 918 bytes} [Sat Oct 15 13:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:42:03.391231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0866a-866c-44dc-bdba-13bcbd5998eb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:03.391518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0866a-866c-44dc-bdba-13bcbd5998eb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:03.391817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0866a-866c-44dc-bdba-13bcbd5998eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:03.475655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:03.479144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b7f0866a-866c-44dc-bdba-13bcbd5998eb None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:03.481152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b7f0866a-866c-44dc-bdba-13bcbd5998eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:03.613240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 544/1090] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Oct 15 13:42:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:06.308306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:06.308875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:06.308875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:06.310196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:06.316448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb03c6f-fe1d-4fe3-97bb-7e7a63e283ce None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:06.316957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb03c6f-fe1d-4fe3-97bb-7e7a63e283ce None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:06.316957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb03c6f-fe1d-4fe3-97bb-7e7a63e283ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:06.394687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9bb03c6f-fe1d-4fe3-97bb-7e7a63e283ce None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:06.395888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9bb03c6f-fe1d-4fe3-97bb-7e7a63e283ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:06.469048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:06.515394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:06.807150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:06.808846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:06.967969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ff9e-9ba7-421a-999b-36df8a46d700 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:07.062020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:07.107680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:07.108344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:07.108621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:07.108886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:07.110560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:07.220560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:07.222088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632bf3-e8d7-433c-8a67-8c8df26a8dda service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:07.241101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 548/1093] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:08.445269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:08.445962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:08.446066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:08.447826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:08.455021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037aa-bbaa-40e4-afc4-12106db7bf8a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:08.457122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037aa-bbaa-40e4-afc4-12106db7bf8a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:08.457122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf037aa-bbaa-40e4-afc4-12106db7bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:08.541447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-edf037aa-bbaa-40e4-afc4-12106db7bf8a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:08.542700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-edf037aa-bbaa-40e4-afc4-12106db7bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:08.575092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:08.655816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:08.808251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:08.809844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:08.972783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d68ad5-cc41-4076-92b4-1a7e04aabad0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:09.016185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:09.106682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:09.107302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:09.107729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:09.108025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:09.110309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:09.214254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:09.215939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850dc11-818b-49a4-a59a-dd4b1e0967ea service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:09.237270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 547/1096] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:10.425136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:10.425752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:10.425752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:10.427059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:10.435270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efcf2-c12f-487e-a1ae-54a80588ba7b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:10.435886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efcf2-c12f-487e-a1ae-54a80588ba7b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:10.435886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efcf2-c12f-487e-a1ae-54a80588ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:10.497982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:10.522732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-331efcf2-c12f-487e-a1ae-54a80588ba7b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:10.524072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-331efcf2-c12f-487e-a1ae-54a80588ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:10.632726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:10.792149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:10.793977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:10.979272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394924d-f5e5-4409-92d6-ec69f809b34b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:10.994570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:11.129017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:11.129654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:11.129934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:11.130200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:11.131875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:11.226936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:11.228795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c00e-c4a3-4dbe-b684-0a14c6969fff service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:11.251551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 551/1099] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:12.413323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:12.413988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:12.413988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:12.415256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:12.423140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8dfa-9e59-4849-be85-a12db7524492 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:12.423698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8dfa-9e59-4849-be85-a12db7524492 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:12.423698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8dfa-9e59-4849-be85-a12db7524492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:12.446598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:12.509133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bd0d8dfa-9e59-4849-be85-a12db7524492 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:12.510460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bd0d8dfa-9e59-4849-be85-a12db7524492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:12.611432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:12.762630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:12.764351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:12.884267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:12.924084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3256c-6750-4ada-8ed7-7d70e4c81772 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:13.051233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:13.051777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:13.052096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:13.052365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:13.053980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:13.139702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:13.155145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:13.156824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d967-3a64-4e02-9b78-57f438ceaa84 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:13.178564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 550/1102] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:14.387090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:14.387711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:14.387711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:14.389062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:14.396276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c994b-77a2-4902-8e79-f200f4cba535 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:14.396812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c994b-77a2-4902-8e79-f200f4cba535 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:14.396812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c994b-77a2-4902-8e79-f200f4cba535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:14.483821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f93c994b-77a2-4902-8e79-f200f4cba535 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:14.485105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f93c994b-77a2-4902-8e79-f200f4cba535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:14.596943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:14.747573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:14.749242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:14.842781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:14.907746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff452e-ade5-4482-a1ad-edc9339c7f30 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:15.026713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:15.027224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:15.027503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:15.027801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:15.029459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:15.082675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:15.127350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:15.129042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af63129-9d90-41dc-8c56-c958ca9ef3d9 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:15.150323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 554/1105] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:16.228579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:16.229155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:16.229155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:16.230482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:16.237244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbb4f-05cf-4417-9f5f-320c43bb7a2b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:16.237739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbb4f-05cf-4417-9f5f-320c43bb7a2b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:16.237830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbb4f-05cf-4417-9f5f-320c43bb7a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:16.322645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-239fbb4f-05cf-4417-9f5f-320c43bb7a2b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:16.323906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-239fbb4f-05cf-4417-9f5f-320c43bb7a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:16.432439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:16.586077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:16.587590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:16.651978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:16.778120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccfb2e-0a04-4e99-b8e1-e571320c8e04 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:16.932800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:16.933424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:16.933698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:16.934008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:16.935855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:16.943842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:17.061441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:17.063074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277290b6-ebaa-49ef-9073-503a43901556 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:17.085903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 553/1108] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:18.310757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:18.311400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:18.311400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:18.312711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:18.319746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa37c-fd60-47bd-b6ed-148d21397876 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:18.320363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa37c-fd60-47bd-b6ed-148d21397876 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:18.320363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa37c-fd60-47bd-b6ed-148d21397876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:18.407010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6eefa37c-fd60-47bd-b6ed-148d21397876 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:18.408245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6eefa37c-fd60-47bd-b6ed-148d21397876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:18.484977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:18.520959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:18.671709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:18.673309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:18.692923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:18.832975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddc517-a932-4ca0-afe3-5c7c81b727a3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:18.922833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:18.951528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:18.952182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:18.952457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:18.952718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:18.954327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:19.047326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:19.048995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dee45d-9127-4016-a51e-9d69a9f56fb6 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:19.069353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 557/1111] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:20.127100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:20.127669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:20.127669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:20.129078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:20.136762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabb13-ad1e-45f9-825c-9abb7650cd42 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:20.137311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabb13-ad1e-45f9-825c-9abb7650cd42 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:20.137311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabb13-ad1e-45f9-825c-9abb7650cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:20.224869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a9eabb13-ad1e-45f9-825c-9abb7650cd42 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:20.226195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a9eabb13-ad1e-45f9-825c-9abb7650cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:20.270334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:20.327908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:20.477623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:20.479566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:20.637619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192ba4-3d4d-4fd4-b042-cbb44c6fdef0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:20.697524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:20.760680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:20.761191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:20.761473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:20.761739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:20.763361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:20.859573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:20.861217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439b29-01ac-49a5-8356-8d4d91274fea service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:20.879985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 556/1114] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:21.953726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:21.954298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:21.954298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:21.955624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:21.963121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3de65-b2df-4435-ae62-f6ca25c159bb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:21.963664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3de65-b2df-4435-ae62-f6ca25c159bb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:21.963664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3de65-b2df-4435-ae62-f6ca25c159bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:22.045666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-cac3de65-b2df-4435-ae62-f6ca25c159bb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:22.046829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cac3de65-b2df-4435-ae62-f6ca25c159bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:22.049273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:22.152455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:22.309367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:22.310830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:22.476000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e988-1050-44cf-9f51-38b2c527333f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:22.507269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:22.598352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:22.598883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:22.599158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:22.599426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:22.601068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:22.699476 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:22.701157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65445b0-c2a1-482f-9c9c-6575766386dd service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:22.723201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 560/1117] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:24.793831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:24.794626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:24.794626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:24.796002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:24.801974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde614d-98af-4349-951c-54878dc75737 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:24.802515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde614d-98af-4349-951c-54878dc75737 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:24.802515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde614d-98af-4349-951c-54878dc75737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:24.847056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:24.873529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0bde614d-98af-4349-951c-54878dc75737 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:24.874768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0bde614d-98af-4349-951c-54878dc75737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:24.981084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:25.265005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:25.266563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:25.372595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9a95e-8f62-4da5-b222-cfd6e7239526 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:25.405787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:25.450173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:25.450812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:25.451087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:25.451354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:25.453014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:25.576816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:25.578391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e0ac-6660-4eb7-adf3-24c15be96a16 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:25.597620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 559/1120] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:42:27.934868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:27.935849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:27.935849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:27.937967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:27.946197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491d7e7-0ae4-4041-9c00-62aafd1af1e2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:27.947089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491d7e7-0ae4-4041-9c00-62aafd1af1e2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:27.947089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491d7e7-0ae4-4041-9c00-62aafd1af1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:28.022348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b491d7e7-0ae4-4041-9c00-62aafd1af1e2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:28.023504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b491d7e7-0ae4-4041-9c00-62aafd1af1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:28.038705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:28.136226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:28.416132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:28.417697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:28.525705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600b46-7de4-48b0-8157-e4d661ec3066 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:28.539268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:28.607178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:28.607830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:28.608115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:28.608389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:28.610023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:28.725410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:28.726866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ace6f3-4f21-47f5-9bb6-02fa3db1a9aa service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:28.745903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 563/1123] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:42:31.268873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:31.269419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:31.269419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:31.270835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:31.276648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91bcbc-3dd9-4708-aa98-4f6053aa8a45 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:31.277164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91bcbc-3dd9-4708-aa98-4f6053aa8a45 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:31.277164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91bcbc-3dd9-4708-aa98-4f6053aa8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:31.327906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:31.349272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6b91bcbc-3dd9-4708-aa98-4f6053aa8a45 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:31.351271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6b91bcbc-3dd9-4708-aa98-4f6053aa8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:31.473885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:31.759340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:31.761785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:31.874830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bf6f-9ead-4fb2-ac0d-db652642a896 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:31.922637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:31.963068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:31.963672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:31.963997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:31.964264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:31.965960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:32.081660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:32.083117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b404-9665-436f-912b-9e3a28c57b63 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:32.103341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 562/1126] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:42:34.415545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:34.416321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:34.416321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:34.417440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:34.423398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475576-5bc8-4853-ae15-9ec12b1c3aa5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:34.423927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475576-5bc8-4853-ae15-9ec12b1c3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:34.424025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475576-5bc8-4853-ae15-9ec12b1c3aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:34.497018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c4475576-5bc8-4853-ae15-9ec12b1c3aa5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:34.498246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c4475576-5bc8-4853-ae15-9ec12b1c3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:34.523283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:34.612672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:34.904159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:34.905732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:35.015258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c8f4-9ecc-45d3-9a77-eed88f7c59af None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:35.037357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:35.104124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:35.104753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:35.105028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:35.105297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:35.106932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:35.226216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:35.227666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfac033-30c7-47d8-b6f2-80387e342e84 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:35.247432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 566/1129] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:37.593619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:37.594184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:37.594184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:37.595534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:37.601140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a597-bb3f-4e3d-bdae-4583c05dcc3c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:37.601575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a597-bb3f-4e3d-bdae-4583c05dcc3c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:37.601685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a597-bb3f-4e3d-bdae-4583c05dcc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:37.669674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:37.672348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0157a597-bb3f-4e3d-bdae-4583c05dcc3c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:37.674333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0157a597-bb3f-4e3d-bdae-4583c05dcc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:37.781992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:38.065832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:38.067434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:38.181876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fab227-d890-4cb5-9d12-b963cdcdf5f9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:38.234266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:38.261140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:38.261780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:38.262068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:38.262312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:38.264060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:38.381605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:38.382973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3b55-6a57-424b-b989-d2499cebfbf0 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:38.403391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 565/1132] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:40.674624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:40.675516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:40.675685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:40.677258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:40.683778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd56d-9345-43fc-9f4c-f95716ebbabd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:40.684320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd56d-9345-43fc-9f4c-f95716ebbabd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:40.684320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd56d-9345-43fc-9f4c-f95716ebbabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:40.762597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c6dcd56d-9345-43fc-9f4c-f95716ebbabd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:40.763828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c6dcd56d-9345-43fc-9f4c-f95716ebbabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:40.796775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:40.872554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:41.153564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:41.155500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:41.264936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7af8-2ca4-4d2c-8a5f-7bcb3e68f028 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:41.295292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:41.342137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:41.342627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:41.342871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:41.343156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:41.344818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:41.460467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:41.461928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692d9d-209d-45d2-9a81-c5b262bc3288 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:41.482586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 569/1135] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:43.694961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:43.695866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:43.695866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:43.698186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:43.704186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b6ce-0f7e-4b99-bf6c-a0be16b97040 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:43.704723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b6ce-0f7e-4b99-bf6c-a0be16b97040 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:43.704723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b6ce-0f7e-4b99-bf6c-a0be16b97040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:43.780182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8291b6ce-0f7e-4b99-bf6c-a0be16b97040 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:43.781421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8291b6ce-0f7e-4b99-bf6c-a0be16b97040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:43.790258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:43.890023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:44.178438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:44.180565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:44.303226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf1fef-3125-499f-bfcd-68596130b010 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:44.361480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:44.380551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:44.381171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:44.381417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:44.381712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:44.383332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:44.503911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:44.505287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2da6bb-17c1-4a64-a9c8-7a58d68223fc service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:44.524223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 568/1138] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:46.721452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:46.721981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:46.721981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:46.723347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:46.729293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baba5a9-d875-4ca3-be13-8da9802afeda None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:46.729910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baba5a9-d875-4ca3-be13-8da9802afeda None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:46.729910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baba5a9-d875-4ca3-be13-8da9802afeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:46.803681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2baba5a9-d875-4ca3-be13-8da9802afeda None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:46.805668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2baba5a9-d875-4ca3-be13-8da9802afeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:46.857054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:46.919953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:47.200789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:47.202410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:47.314012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2e8fb-0fcd-44e7-b768-ee658b741411 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:47.356273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:47.399930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:47.400680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:47.401015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:47.401337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:47.403228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:47.538790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:47.540584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a60d5a-0eab-4dc6-bd8c-ce116d51971f service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:47.563233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 572/1141] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:49.737350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:49.737943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:49.737943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:49.739367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:49.745614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496542-7575-43b8-9feb-0546bd542c7e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:49.746134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496542-7575-43b8-9feb-0546bd542c7e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:49.746134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496542-7575-43b8-9feb-0546bd542c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:49.817352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b4496542-7575-43b8-9feb-0546bd542c7e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:49.818607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b4496542-7575-43b8-9feb-0546bd542c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:49.839334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:49.921848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:42:50.202940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:50.204531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:50.318311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821e5b-cfa6-443b-a8c9-f489e283b3a3 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:50.401447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:50.408851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:50.409488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:50.409999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:50.410270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:50.411930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:50.542364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:50.543902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c250d-80d5-4f88-8723-57f7352606aa service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:50.564138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 571/1144] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:52.813491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:52.814094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:52.814094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:52.815487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:42:52.824376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fa29-44c4-4ddd-84ea-98b779a95bac None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:52.824953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fa29-44c4-4ddd-84ea-98b779a95bac None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:52.824953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fa29-44c4-4ddd-84ea-98b779a95bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:52.897189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-55c6fa29-44c4-4ddd-84ea-98b779a95bac None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:42:52.898416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-55c6fa29-44c4-4ddd-84ea-98b779a95bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:52.952942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:53.003102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:42:53.288358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:42:53.290803 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:53.412726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375d4b-32c6-49e8-9fdd-767ae91ea3b2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:42:53.468957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:53.500589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:42:53.501213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:42:53.501491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:42:53.501758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:42:53.503395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:42:53.618384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:42:53.619751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11be52-37b3-41fd-8d69-7df3390b428c service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:42:53.639023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 575/1147] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:03.001587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=22 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:03.636434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=66 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:13.755397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fd0-f151-4890-aa3d-cfc9f27a1d08 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:13.756083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fd0-f151-4890-aa3d-cfc9f27a1d08 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:13.756083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fd0-f151-4890-aa3d-cfc9f27a1d08 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:13.757348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 573/1148] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:13.763853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc3c-2fa9-418f-a9f1-98d3ff3c2b63 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:13.764382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc3c-2fa9-418f-a9f1-98d3ff3c2b63 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:13.764382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc3c-2fa9-418f-a9f1-98d3ff3c2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:13.839024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f004bc3c-2fa9-418f-a9f1-98d3ff3c2b63 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:13.840788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f004bc3c-2fa9-418f-a9f1-98d3ff3c2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:13.954310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 576/1149] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:14.253682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:14.253962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:14.254257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:14.255647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 574/1150] 10.222.0.33 () {54 vars in 962 bytes} [Sat Oct 15 13:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:14.261007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7182-795b-4339-bbec-6c8f2236804f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:14.261292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7182-795b-4339-bbec-6c8f2236804f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:14.261879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7182-795b-4339-bbec-6c8f2236804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:14.345308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7e1e7182-795b-4339-bbec-6c8f2236804f None None] MFA Rules not processed for user `5f309ff57750472c9011ccf17eb7089e`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:14.346538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7e1e7182-795b-4339-bbec-6c8f2236804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:14.369814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:14.426784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 577/1151] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Oct 15 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:14.435205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:14.436827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:14.543513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac2a0-6831-4569-9fa6-f7d67fb8a09c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:14.626931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:14.627548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:14.627822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:14.628117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:14.629714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:14.688735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:14.748440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:14.749952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1dce1-7fe4-43a7-9543-a19f8744bc4d service glance] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:14.773207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 575/1152] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:17.101709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:17.102134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:17.102244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:17.103670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 578/1153] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:17.109693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88220830-d22b-42d6-a582-c0936d0810bd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:17.110185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88220830-d22b-42d6-a582-c0936d0810bd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:17.110185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88220830-d22b-42d6-a582-c0936d0810bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:17.184935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-88220830-d22b-42d6-a582-c0936d0810bd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:17.186183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-88220830-d22b-42d6-a582-c0936d0810bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:17.288383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 576/1154] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:17.570965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:17.572559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:17.718917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b261-02fb-4df0-aa0c-5117c45a8e12 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:17.776353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:17.830537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:17.831065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:17.831340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:17.831621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:17.832322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:17.833462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:43:17.833462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:43:17.833462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:43:17.834622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c5a97-d109-4ac7-bfbd-6ef3d88a419d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:17.859678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 579/1155] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Oct 15 13:43:17 2022] GET /identity/v3/projects => generated 2553 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:43:20.131900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:20.132468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:20.132468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:20.133864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 577/1156] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:20.140046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa035-d1d3-4427-af67-e1dc775646a0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:20.140572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa035-d1d3-4427-af67-e1dc775646a0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:20.140663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa035-d1d3-4427-af67-e1dc775646a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:20.212917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e4caa035-d1d3-4427-af67-e1dc775646a0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:20.214162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e4caa035-d1d3-4427-af67-e1dc775646a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:20.325677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 580/1157] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:20.621721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:20.623494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:20.633794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:20.778013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e26ae9-1122-4046-814b-56ae74658df7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:20.866515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:20.901438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:20.902048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:20.902380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:20.902771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:20.904620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:20.997423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:20.999043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ec4c-5e97-496d-b679-e6495028890c service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:21.017775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 578/1158] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:23.366938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:23.367514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:23.367514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:23.368885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 581/1159] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:23.374824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e38d4-afe3-427c-9681-43477831619d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:23.375297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e38d4-afe3-427c-9681-43477831619d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:23.375417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e38d4-afe3-427c-9681-43477831619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:23.447125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-326e38d4-afe3-427c-9681-43477831619d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:23.448381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-326e38d4-afe3-427c-9681-43477831619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:23.495531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:23.550207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 579/1160] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:23.836658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:23.838211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:23.865793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:23.953192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecaca62-f3c1-4318-9982-590588c27179 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:24.033123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:24.033657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:24.033934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:24.034206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:24.035852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:24.120334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:24.156494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:24.157934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641469fb-e1ea-4cbd-8198-e32b61f96068 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:24.176817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 582/1161] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:26.380542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:26.381168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:26.381168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:26.382505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 580/1162] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:26.388771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517101d4-e105-48f2-ba0f-416aafe2c6f5 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:26.389244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517101d4-e105-48f2-ba0f-416aafe2c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:26.389346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517101d4-e105-48f2-ba0f-416aafe2c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:26.461375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-517101d4-e105-48f2-ba0f-416aafe2c6f5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:26.462603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-517101d4-e105-48f2-ba0f-416aafe2c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:26.568715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 583/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:26.857255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:26.858856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:26.971066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038b9f-ec38-4013-aa05-890e05d330f7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:27.046339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:27.047986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:27.048699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:27.048955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:27.049380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:27.051557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:27.171339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:27.172843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a3b69-aeff-4b35-b174-ed907925576f service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:27.192705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 581/1164] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:29.542878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:29.543966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:29.543966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:29.544932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 584/1165] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:29.550670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477b6c-930d-4081-b82f-2a6f5da34bca None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:29.551212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477b6c-930d-4081-b82f-2a6f5da34bca None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:29.551212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477b6c-930d-4081-b82f-2a6f5da34bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:29.625493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-07477b6c-930d-4081-b82f-2a6f5da34bca None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:29.626731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-07477b6c-930d-4081-b82f-2a6f5da34bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:29.690167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:29.741988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 582/1166] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:43:30.026127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:30.027777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:30.070518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:30.144804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb0aa-35f2-46d2-924a-3ced96019d9d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:30.226700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:30.227320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:30.227591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:30.227890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:30.229479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:30.319382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:30.349692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:30.351132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532adb5-98f5-4b5b-a8ca-1b0ed8123223 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:30.370330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 585/1167] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:32.804306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:32.804878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:32.804878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:32.806233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 583/1168] 10.222.0.33 () {54 vars in 927 bytes} [Sat Oct 15 13:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:43:32.812632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963c75-e495-40f6-b0da-45dbfd16e655 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:32.813115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963c75-e495-40f6-b0da-45dbfd16e655 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:32.813232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963c75-e495-40f6-b0da-45dbfd16e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:32.900392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-64963c75-e495-40f6-b0da-45dbfd16e655 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:43:32.902386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-64963c75-e495-40f6-b0da-45dbfd16e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:33.020213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 586/1169] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Oct 15 13:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:43:33.318721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:43:33.320390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:33.436873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953020-ee86-4747-8c95-60392dd5c7d9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:43:33.514585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:43:33.515203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:43:33.515470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:43:33.515734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:43:33.517368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:43:33.526454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:33.638181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:43:33.639553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b5dea-07d2-4900-abce-a0307380a360 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:43:33.659527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 584/1170] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:43:43.018537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=82 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:43.656757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=50 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:54.166792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:54.167376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:54.167376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:54.254587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:44:54.255828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:54.367013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 587/1171] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:44:54.375564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:54.376202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:54.376202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:54.466631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:44:54.467975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:54.574107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 585/1172] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:44:54.579385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:54.581019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:54.597855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63922f9-c496-4768-aafe-87f5c4920c80 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:54.664535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:54.703290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:54.703954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:54.704230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:54.704501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:54.705156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:44:54.705455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:54.706475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:44:54.706475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:44:54.706475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:44:54.707372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:54.723633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 588/1173] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:44:54.733324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:54.743417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8bb5-7c08-4293-afd9-4d9374880d94 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:54.811813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:54.847150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:54.847771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:54.848098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:54.848369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:54.849059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:54.850188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:44:54.850188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:44:54.850188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:44:54.851423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:54.911748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 586/1174] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:44:54 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:44:54.916204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:54.917734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:54.952849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a388-2d68-49f9-bf9b-e0c0b8c9c6b4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:55.051892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:55.052415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.052680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.052946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.053573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:55.054589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:44:55.054589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:44:55.054589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:44:55.055769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:55.103114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 589/1175] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:44:54 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:44:55.107460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:55.109222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:55.174171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5772970-d7f5-4073-a010-e58e1555cb30 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:55.269266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:55.282553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:55.283181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.283461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.283734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.284438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:55.286078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:55.303462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 587/1176] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:44:55.307903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:55.310094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:55.324577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a001-ab9e-40f9-b67e-2130f397ecbe admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:55.350801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:55.433526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:55.434491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.434781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.435040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.435694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:55.437486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeda66-d56b-4722-93f3-3a9545b44702 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:55.450663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 590/1177] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:44:55.455312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:55.457030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:55.493178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163544-5bef-4d9a-bbcc-c334d87fb9b6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:55.595443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:55.596044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.596318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.596587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] PATH_INFO: `/v3/projects/4335cdc594bc452aa398e9067cb3e5e2/users/1f59e96446054d138c551b30d9f68f9a/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.623257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4335cdc594bc452aa398e9067cb3e5e2, user_id=1f59e96446054d138c551b30d9f68f9a, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:55.626061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d49f-0627-432a-bd09-282ac40dd0b6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:55.654136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 588/1178] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:44:55 2022] PUT /identity/v3/projects/4335cdc594bc452aa398e9067cb3e5e2/users/1f59e96446054d138c551b30d9f68f9a/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:44:55.665856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77d56-06b5-408a-af62-bb42fb6aaedf None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.666092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77d56-06b5-408a-af62-bb42fb6aaedf None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.666374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77d56-06b5-408a-af62-bb42fb6aaedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.730921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-16d77d56-06b5-408a-af62-bb42fb6aaedf None None] MFA Rules not processed for user `1f59e96446054d138c551b30d9f68f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:44:55.732187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-16d77d56-06b5-408a-af62-bb42fb6aaedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:55.815067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 591/1179] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:44:55.829173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.829451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.829720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.831097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 589/1180] 10.222.0.33 () {54 vars in 963 bytes} [Sat Oct 15 13:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:44:55.836316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64282-e7ee-43ce-bfdd-8d7af015e053 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:55.836599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64282-e7ee-43ce-bfdd-8d7af015e053 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:55.836864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64282-e7ee-43ce-bfdd-8d7af015e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:55.870234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:55.918978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-99f64282-e7ee-43ce-bfdd-8d7af015e053 None None] MFA Rules not processed for user `4fb1ad7b1aec4c5f99b1341e62d18c04`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:44:55.920346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-99f64282-e7ee-43ce-bfdd-8d7af015e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:56.001957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 592/1181] 10.222.0.33 () {58 vars in 1060 bytes} [Sat Oct 15 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:44:56.010114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:56.011681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:56.065673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:56.122660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991df3-3eb3-4065-980f-e9a3bb4c767b None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:56.200670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:56.201294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:56.201563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:56.201852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:56.203653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:56.312915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:56.314408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:56.318011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:56.333733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 590/1182] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:44:56.380975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284681-cf6f-4cb1-905c-e8c9cdda49ae None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:56.381430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284681-cf6f-4cb1-905c-e8c9cdda49ae None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:56.381535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284681-cf6f-4cb1-905c-e8c9cdda49ae None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:56.382818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 593/1183] 10.222.0.33 () {52 vars in 830 bytes} [Sat Oct 15 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:44:56.386686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:56.387961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:56.495703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba3ec-edd9-4ac0-8cb3-a35c574b92d3 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:56.596736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:56.597379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:56.597655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:56.597927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] PATH_INFO: `/v3/users/1f59e96446054d138c551b30d9f68f9a` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:56.611999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f59e96446054d138c551b30d9f68f9a)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:56.613040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:44:56.613040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:44:56.613040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:44:56.614279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:56.624500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:56.687029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f59e96446054d138c551b30d9f68f9a'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:56.701505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f59e96446054d138c551b30d9f68f9a'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:56.701980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f59e96446054d138c551b30d9f68f9a'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:56.702744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f59e96446054d138c551b30d9f68f9a'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:56.714429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f59e96446054d138c551b30d9f68f9a'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:56.745372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 591/1184] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:44:56 2022] DELETE /identity/v3/users/1f59e96446054d138c551b30d9f68f9a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:44:56.750469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:56.750755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:56.751030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:56.811758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:44:56.813112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:56.901536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:56.914517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 594/1185] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:44:56.924843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:56.926085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:57.042642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1436-5de5-4f00-a363-e57694c54487 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:57.100741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:44:57.123494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:57.124564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:57.124848 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:57.125121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:57.126756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:57.243610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:57.245091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5013bc-7217-4183-9fe4-701b0e682448 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:57.263932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 592/1186] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:44:57.606625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:44:57.608357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:44:57.624590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475bed5-0095-4bce-9171-5c3f420867ff None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:44:57.730694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:44:57.731338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:44:57.731618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:44:57.731922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] PATH_INFO: `/v3/projects/4335cdc594bc452aa398e9067cb3e5e2` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:44:57.743423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4335cdc594bc452aa398e9067cb3e5e2)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:44:57.744702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:44:57.744702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:44:57.744702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:44:57.746187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:44:57.810070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4335cdc594bc452aa398e9067cb3e5e2', 'request_id': 'req-a3a140af-d977-42f9-85c8-a66375d4c129'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:57.826114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4335cdc594bc452aa398e9067cb3e5e2', 'request_id': 'req-a3a140af-d977-42f9-85c8-a66375d4c129'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:57.837639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4335cdc594bc452aa398e9067cb3e5e2', 'request_id': 'req-a3a140af-d977-42f9-85c8-a66375d4c129'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:57.865126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] The token cache is being invalidate because project 4335cdc594bc452aa398e9067cb3e5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:44:57.865416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:57.865841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a3a140af-d977-42f9-85c8-a66375d4c129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:44:57.867275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 595/1187] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:44:57 2022] DELETE /identity/v3/projects/4335cdc594bc452aa398e9067cb3e5e2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:45:07.261541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=62 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:45:07.862780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:32.206548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:32.207165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:32.207165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:32.208503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 593/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:32.215017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c152-2b7a-425c-833b-465c359d7a28 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:32.215543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c152-2b7a-425c-833b-465c359d7a28 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:32.215644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c152-2b7a-425c-833b-465c359d7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:32.304677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1e28c152-2b7a-425c-833b-465c359d7a28 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:32.305905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1e28c152-2b7a-425c-833b-465c359d7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:32.423391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 596/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:32.585791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:32.588971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:32.719690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74549eb-ebc5-4f80-b0a9-af4b4c19ac05 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:32.726573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:32.727196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:32.727473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:32.727770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:32.736638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:32.738263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252f24-c5ba-40fc-a734-6bf910f3a30c service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:32.748764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 594/1190] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:33.871418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc26f9-16c4-456d-8d49-7ee2fec1d903 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:33.872046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc26f9-16c4-456d-8d49-7ee2fec1d903 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:33.872046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc26f9-16c4-456d-8d49-7ee2fec1d903 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:33.873436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 597/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:33.880493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9772c03-25ad-4293-b207-2c4cc6dad7a0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:33.881095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9772c03-25ad-4293-b207-2c4cc6dad7a0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:33.881095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9772c03-25ad-4293-b207-2c4cc6dad7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:33.901634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d9772c03-25ad-4293-b207-2c4cc6dad7a0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:33.902871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d9772c03-25ad-4293-b207-2c4cc6dad7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:33.911246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 595/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:34.066583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc26f9-16c4-456d-8d49-7ee2fec1d903 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:34.082930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc26f9-16c4-456d-8d49-7ee2fec1d903 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:34.089354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:34.089977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:34.090258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:34.090529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:34.099402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:34.101070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93481ed-a4ac-4c1b-91eb-8db3bd5dc9a2 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:34.111297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 598/1193] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:34.227961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8767d-8ad7-4649-aca3-f31a5f907de8 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:34.228376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8767d-8ad7-4649-aca3-f31a5f907de8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:34.228712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8767d-8ad7-4649-aca3-f31a5f907de8 None None] PATH_INFO: `/v3` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:34.230118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 596/1194] 10.222.0.25 () {54 vars in 925 bytes} [Sat Oct 15 13:46:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:46:34.236903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b5b8-87ff-40fa-b1e1-753006da1f90 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:34.237250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b5b8-87ff-40fa-b1e1-753006da1f90 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:34.237497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b5b8-87ff-40fa-b1e1-753006da1f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:34.303238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6bd3b5b8-87ff-40fa-b1e1-753006da1f90 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:34.304633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6bd3b5b8-87ff-40fa-b1e1-753006da1f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:34.323287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:34.385365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 599/1195] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Oct 15 13:46:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:37.945819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861bdcb-777e-4830-a46d-efb5476199cd None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:37.946375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861bdcb-777e-4830-a46d-efb5476199cd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:37.946375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861bdcb-777e-4830-a46d-efb5476199cd None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:37.947818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 597/1196] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:37.953088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e194c-9335-45f9-b65e-22fdaa00e903 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:37.953533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e194c-9335-45f9-b65e-22fdaa00e903 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:37.953632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e194c-9335-45f9-b65e-22fdaa00e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:37.974190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c95e194c-9335-45f9-b65e-22fdaa00e903 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:37.975401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c95e194c-9335-45f9-b65e-22fdaa00e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:37.986092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 600/1197] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:37.993953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861bdcb-777e-4830-a46d-efb5476199cd None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:38.010124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861bdcb-777e-4830-a46d-efb5476199cd None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:38.016229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:38.016832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:38.017115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:38.017383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:38.026041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:38.027668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bda208-21b7-4d6f-8290-9018d59a7e57 service placement] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:38.037133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 598/1198] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:45.628376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc884da-4270-4bfb-8d34-772e28c8108c None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:45.629044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc884da-4270-4bfb-8d34-772e28c8108c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:45.629044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc884da-4270-4bfb-8d34-772e28c8108c None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:45.630206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 601/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:45.637643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20d3c-87d5-420c-afdc-3a5e26dbc108 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:45.638437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20d3c-87d5-420c-afdc-3a5e26dbc108 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:45.638575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20d3c-87d5-420c-afdc-3a5e26dbc108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:45.665864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-46b20d3c-87d5-420c-afdc-3a5e26dbc108 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:45.667094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-46b20d3c-87d5-420c-afdc-3a5e26dbc108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:45.676870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 599/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:45.831980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc884da-4270-4bfb-8d34-772e28c8108c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:45.857780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc884da-4270-4bfb-8d34-772e28c8108c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:45.863990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:45.864610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:45.864903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:45.865165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:45.874576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:45.876212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00e59-9904-4716-af1c-cd242bb47b1d service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:45.887272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 602/1201] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:46.958629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e091-6af1-4d11-a452-f6257993faa2 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:46.959546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e091-6af1-4d11-a452-f6257993faa2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:46.959546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e091-6af1-4d11-a452-f6257993faa2 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:46.961727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 600/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 15 13:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:46.971322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955d16-0df6-413e-8812-0ef921bdf876 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:46.971894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955d16-0df6-413e-8812-0ef921bdf876 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:46.971894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955d16-0df6-413e-8812-0ef921bdf876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:46.994084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-85955d16-0df6-413e-8812-0ef921bdf876 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:46.995387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-85955d16-0df6-413e-8812-0ef921bdf876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:47.004128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 603/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 15 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:47.158590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e091-6af1-4d11-a452-f6257993faa2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:47.175512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e091-6af1-4d11-a452-f6257993faa2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:47.183614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:47.184386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:47.184665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:47.184924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:47.194502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:47.196513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45cd6f-55f3-4811-8539-37206f24888e service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:47.207947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 601/1204] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:51.218587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:51.219189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:51.219189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:51.220537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 604/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:51.227158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b19f2-053f-4f56-8596-de9b43e4a611 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:51.227601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b19f2-053f-4f56-8596-de9b43e4a611 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:51.227777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b19f2-053f-4f56-8596-de9b43e4a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:51.250053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f26b19f2-053f-4f56-8596-de9b43e4a611 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:51.251238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f26b19f2-053f-4f56-8596-de9b43e4a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:51.260356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 602/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:51.551285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:51.553395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:51.636049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1cf9-e882-4c2c-84d9-20dce7528735 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:51.640715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:51.641337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:51.641614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:51.641880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:51.652840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:51.654459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f43f-07dd-4a7e-844f-e110ab4df55b service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:51.666112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 605/1207] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:53.828853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca569a1-c7b4-4043-9a01-4c6d67174e76 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:53.829449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca569a1-c7b4-4043-9a01-4c6d67174e76 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:53.829449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca569a1-c7b4-4043-9a01-4c6d67174e76 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:53.830748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 603/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:53.836450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380aa5-5034-42b3-b605-848d02471ede None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:53.836896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380aa5-5034-42b3-b605-848d02471ede None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:53.837013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380aa5-5034-42b3-b605-848d02471ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:53.859520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-46380aa5-5034-42b3-b605-848d02471ede None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:53.860776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-46380aa5-5034-42b3-b605-848d02471ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:53.869793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 606/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:54.160611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca569a1-c7b4-4043-9a01-4c6d67174e76 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:54.173165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca569a1-c7b4-4043-9a01-4c6d67174e76 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:54.177514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:54.178125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:54.178401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:54.178668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:54.189061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:54.190512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716eafc-c405-4e31-b2c8-cf34e5960e38 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:54.200995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 604/1210] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:46:57.906619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:57.907643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:57.907643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:57.909759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 607/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:46:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:46:57.915376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f734b-99ae-4a0c-98f6-7b1209947eca None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:57.915864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f734b-99ae-4a0c-98f6-7b1209947eca None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:57.915979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f734b-99ae-4a0c-98f6-7b1209947eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:57.924656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=81 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:57.938446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7b1f734b-99ae-4a0c-98f6-7b1209947eca None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:46:57.939645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7b1f734b-99ae-4a0c-98f6-7b1209947eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:57.948209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 605/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:46:58.248010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:46:58.250538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:46:58.321928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:58.336787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d9fd4-c87d-423d-87f2-726849a3669c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:46:58.341366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:46:58.341990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:46:58.342545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:46:58.342819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:46:58.353395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:46:58.354970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985636d1-82f2-4bae-a360-1d364db4c910 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:46:58.365481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 608/1213] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:47:00.548628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:47:00.549268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:47:00.549268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:47:00.550522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 606/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 15 13:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:47:00.556055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fef54-e4d2-44c6-92f3-679731d1fbb4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:47:00.556532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fef54-e4d2-44c6-92f3-679731d1fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:47:00.556636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fef54-e4d2-44c6-92f3-679731d1fbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:47:00.579086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-008fef54-e4d2-44c6-92f3-679731d1fbb4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:47:00.580382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-008fef54-e4d2-44c6-92f3-679731d1fbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:47:00.590574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 609/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 15 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:47:00.892132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:47:00.894212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:47:00.909045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c9106-5c64-43cb-a832-2cc52aea8b22 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:47:00.912991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:47:00.913590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:47:00.913865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:47:00.914133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:47:00.923554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:47:00.925034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aea5b-e2a3-46bf-a1fb-dbbe8fd20d6e service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:47:00.934754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 607/1216] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:47:10.573608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=11 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:47:10.930332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=8 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:29.569194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.570132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.570132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.597805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:29.599050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:29.609497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 610/1217] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:48:29.620648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.621730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.622252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.649289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:29.650950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:29.664302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 608/1218] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:29.670812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:29.687149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332282f0-7e32-451a-ba4f-a0b6ef60f874 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:29.697771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:29.698589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.698870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.699151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.699913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:29.700840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:29.702852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:29.730833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 611/1219] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:29.740097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:29.760212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab41764-9506-4b43-ac7e-56119da239eb None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:29.770894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:29.772233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.772763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.773264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.774210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:29.776541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dd3cc-28d4-4156-85af-81c66b35fa20 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:29.831890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 609/1220] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:29 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:29.837057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:29.854828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe66c-efbd-4dd3-8a08-a3bcf3901f79 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:29.946032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0c-ef34-4a24-8ae3-e422a3ea6576 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.946940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0c-ef34-4a24-8ae3-e422a3ea6576 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.947453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0c-ef34-4a24-8ae3-e422a3ea6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.949699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:29.950809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:29.951089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:29.951366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:29.952084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:29.955922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:29.988315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e9802e0c-ef34-4a24-8ae3-e422a3ea6576 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:29.988949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 612/1221] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:29 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:29.993588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e9802e0c-ef34-4a24-8ae3-e422a3ea6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.004940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.006964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 610/1222] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:48:30.018433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.019092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.019581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.022079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b893da-92c5-4cbd-9ca9-d7171efeca9d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.035860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.035860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.035860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.035860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.036543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.037544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.060527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 613/1223] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:30.063815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.063815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.076057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.093649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007900-391f-4bf4-9148-b49b6e308c95 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.103554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.104649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.105162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.105663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.105783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 611/1224] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:48:30.107568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.109826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.115819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.138562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 614/1225] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:30.138796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b232705-9902-45b1-b4a9-1aba201fec39 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.145802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.152570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.153744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.153744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.153971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.154585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:30.154894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.156041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:48:30.156041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:48:30.156041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:48:30.156903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.165340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09f92-13b8-4cec-bff7-b742c0af6625 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.172510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.173648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.174140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.174628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] PATH_INFO: `/v3/projects/f71e22f02b0a41e9bbc171622626b681/users/dc57e9716aa849a9864745592e920c69/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.184690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 612/1226] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:30.193406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.218239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71e22f02b0a41e9bbc171622626b681, user_id=dc57e9716aa849a9864745592e920c69, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.221942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa58546-1c44-4b47-9447-5be1ca57a61f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.222246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0f7d-eba9-4b2f-aaff-90180b7a3e43 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.247841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.247841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.247841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.247841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.248343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.248766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3fc22-ca3c-4816-acca-97b228214414 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.260341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 615/1227] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:30 2022] PUT /identity/v3/projects/f71e22f02b0a41e9bbc171622626b681/users/dc57e9716aa849a9864745592e920c69/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:48:30.278276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda8e2-c31b-4f6e-a1a9-e18a037a04b0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.279738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda8e2-c31b-4f6e-a1a9-e18a037a04b0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.280284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda8e2-c31b-4f6e-a1a9-e18a037a04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.320051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ccbda8e2-c31b-4f6e-a1a9-e18a037a04b0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.322106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ccbda8e2-c31b-4f6e-a1a9-e18a037a04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.333949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 613/1228] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:48:30.335359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.335657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.335959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.388422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.389662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.406389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 616/1229] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.408162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.408723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.409481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.435254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.437029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.463093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.536091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 617/1230] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.537063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.548481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5709585-bc00-43cc-93c3-bd551b9b508b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.550683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 614/1231] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.551867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.553582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.554820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.555840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.556135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.556455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.557072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.559085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8cd4b-a096-4ee0-b3c3-16d7750b93ac admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.590307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 618/1232] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:30.596116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31395-fde4-4bc5-8976-806c27264f24 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.596429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31395-fde4-4bc5-8976-806c27264f24 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.596781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31395-fde4-4bc5-8976-806c27264f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.617649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-85a31395-fde4-4bc5-8976-806c27264f24 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.618902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-85a31395-fde4-4bc5-8976-806c27264f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.628217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 619/1233] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.630650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538099a3-adf5-4424-9029-0172027edceb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.631137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538099a3-adf5-4424-9029-0172027edceb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.631646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538099a3-adf5-4424-9029-0172027edceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.634733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd3ce3-66d8-4a9e-99ce-3499eb978d80 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.643328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.643982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.644256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.644521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.656005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.657458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53831b44-98e3-4de8-a4ba-9e7e986619e4 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.659360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-538099a3-adf5-4424-9029-0172027edceb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.660648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-538099a3-adf5-4424-9029-0172027edceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.668934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 615/1234] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:30.680062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 620/1235] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.680662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.680662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.680662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.680886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd926-8e33-4eb9-bcfa-b3e210a8cae6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.680886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd926-8e33-4eb9-bcfa-b3e210a8cae6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.680886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd926-8e33-4eb9-bcfa-b3e210a8cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.694063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5d9cd926-8e33-4eb9-bcfa-b3e210a8cae6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.695276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5d9cd926-8e33-4eb9-bcfa-b3e210a8cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.698814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.700519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.705083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 621/1236] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.706633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce7519-39a9-45c4-adbe-ecfdb6cceb35 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.707048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce7519-39a9-45c4-adbe-ecfdb6cceb35 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.707264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce7519-39a9-45c4-adbe-ecfdb6cceb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.727431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 616/1237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.728361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.738515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-78ce7519-39a9-45c4-adbe-ecfdb6cceb35 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.740881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-78ce7519-39a9-45c4-adbe-ecfdb6cceb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.746328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6f68a-e441-4685-baaa-5a49e03c0292 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.752153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.752803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.753089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.753376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.754008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.755837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571bf33-9839-4467-a4ca-437a8aba3b62 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.758715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 622/1238] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.761130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285966-193b-48df-8ef5-6bc47c48da6c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.761450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285966-193b-48df-8ef5-6bc47c48da6c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.761694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285966-193b-48df-8ef5-6bc47c48da6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.766769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.781906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 617/1239] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:30.783836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.784355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.784819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.788026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-29285966-193b-48df-8ef5-6bc47c48da6c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.789791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-29285966-193b-48df-8ef5-6bc47c48da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.801385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 623/1240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.802718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c83ba-3f2c-4433-9449-24d7fe917e88 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.803014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c83ba-3f2c-4433-9449-24d7fe917e88 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.803335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c83ba-3f2c-4433-9449-24d7fe917e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.829290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.831071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.831352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8d6c83ba-3f2c-4433-9449-24d7fe917e88 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.833310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8d6c83ba-3f2c-4433-9449-24d7fe917e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.848000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 618/1241] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.848000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.848455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 624/1242] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.853332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.853740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.854152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.856824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634d38-6e8f-47a5-a48c-0b3e8beaf352 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.863090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.864087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.864575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.864857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.865534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:30.865838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.867589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.882694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.883424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 619/1243] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:30.884258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.889952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.897342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf571-9131-4251-96b2-00ccedd55b52 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.906168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 625/1244] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.906168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.908452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.909082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.909424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.909758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.910485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:30.910813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.912861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ea27b-97dc-4212-a4e4-32f70f7d42aa admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.941455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 620/1245] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:30.941455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.941455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.941455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.942240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8020-0328-46d5-b895-7d7a5f2443b0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:30.947046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:30.947404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:30.947565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:30.947917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:30.948533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:30.951030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:30.967705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:30.968816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:30.979075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 621/1246] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:30.980154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:30.987403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 626/1247] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:30.987403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.001941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073df7e-dbc9-47db-9208-e21ffefd73b8 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.007525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.008209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.008479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.008981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.009755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:31.010034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.011746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.012661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648c8ae-99fc-4993-93df-d841b4633515 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.024676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.025758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.026255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.026949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.028303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:31.029098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.036798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 622/1248] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:31.036798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.037116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.053298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c130b-d865-4953-89a5-0cdfe74465bc admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.062915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.063761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 627/1249] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:31.064171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.064171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.064582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.065234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.065528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.067489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.088845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e737cc-d9b7-45e3-b207-435bde229ec7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.097900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.098744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.099108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.099569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.100705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:31.101122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.103349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.115486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 623/1250] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.115486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.139839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 628/1251] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:31.139839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.159954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283d28b-06a5-42ab-9830-a79a612cb552 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.230655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58777261-5219-4fff-9ff1-8bf4be00e17d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.237791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.238528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.238889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.239581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.240412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.242707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.306275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.307378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.307886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.308321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.309263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:31.309933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.312262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.313387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 624/1252] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.315675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.330228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 629/1253] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:31.331842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.358775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdabe21-e243-48cf-8a07-3a6f7ec4a90b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.380814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:31.468552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.469448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.469667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.470096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.470353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5accb8-6599-443b-a0fa-42cf1cda0c4d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.470916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.471970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:48:31.471970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:48:31.471970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:48:31.473371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.475772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.476724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.477161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.477446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] PATH_INFO: `/v3/projects/72ff9afb91e44b1787cb6ed31fc7f6d9/users/9fb93332b7e54ca78eb51566343fca16/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.495286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ff9afb91e44b1787cb6ed31fc7f6d9, user_id=9fb93332b7e54ca78eb51566343fca16, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.499060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.502348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:31.515517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 630/1254] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.517622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.523915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 625/1255] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:31 2022] PUT /identity/v3/projects/72ff9afb91e44b1787cb6ed31fc7f6d9/users/9fb93332b7e54ca78eb51566343fca16/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:31.525313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.608127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc42-f445-4746-b8b0-88222eb50f67 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.614302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.615032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.615371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.615705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.616475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.617592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:48:31.617592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:48:31.617592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:48:31.619080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.620570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9d3d-7c90-4a24-b079-d33d056bb504 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.629282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.630213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.630692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.631184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.632688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.637930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.649813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 626/1256] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.649813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.660354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5ea5-9944-481a-9faa-a35722e24d32 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.667560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.668410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.668785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.669646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.670006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.672810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.718180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 631/1257] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.719509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.734991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 627/1258] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.736533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.868376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5596f-7365-48d7-9c22-4f73e99ac403 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.885420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.886969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.887413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9fb31-6d24-4c86-8407-82d376fb26cf admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:31.888001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.888856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.890860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.895854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ae3b2-9b4a-440a-a542-9858ab013854 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.896167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:31.897354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.897858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.898347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.899707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:31.903956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:31.958969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 632/1259] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.960594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:31.976733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 628/1260] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:31.976733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:31.976733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:31.976733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:31.994602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb35b-4758-4f64-85ed-644a651af56b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.021868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:32.046591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] MFA Rules not processed for user `9fb93332b7e54ca78eb51566343fca16`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:32.048570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:32.109911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:32.126449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.127659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.128190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.128624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.130095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.134901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.183611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 629/1261] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:32.183611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.186406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 633/1262] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:31 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:32.188220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.206680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91b83b-de43-48a8-a909-70d1ba4476a2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.208442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2880a4-6403-431e-b097-b6dc2ce4c66e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.215231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.216554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.216554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.216778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.217423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.219339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.219550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.220379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.221621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.224320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.225634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.235711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.239292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 630/1263] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.239292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.249834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b122e7-3f16-4d8a-8155-b36bccb3463f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.263647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.265176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.265859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.267270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.269145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.274052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.293227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 634/1264] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:32 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:32.296882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.321523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 631/1265] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:32 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:32.326855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.332250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2446-8109-4deb-8af8-35a479aa055b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.337541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8e9c-3f87-4f25-bd0a-dc634c488846 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.341112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.342848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.342848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.343393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.344046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.344770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.344941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.345167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.345500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.346306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.348474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a301c-d76c-422a-a74b-baae8e69282e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.350210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.383480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 635/1266] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.383480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.383980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 632/1267] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:32 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:32.384950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ea12-c804-4c82-bde6-6cb114c043a1 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.385391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ea12-c804-4c82-bde6-6cb114c043a1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.385725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ea12-c804-4c82-bde6-6cb114c043a1 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.388276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 633/1268] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:48:32.389646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ea12-c804-4c82-bde6-6cb114c043a1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.407262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d4a5-c508-4305-bd13-435ffdc1d913 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.412681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ea12-c804-4c82-bde6-6cb114c043a1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.413260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.413988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.414330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.414675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.415524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.417239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.422727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.424785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.424785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.424785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.426195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.429354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.431493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 636/1269] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.432457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.445335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0032d-78dd-4002-bc13-675ec29be76c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.452296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.452946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.453224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.453587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.454190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.456195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.465930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 634/1270] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.467843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.473129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 637/1271] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.473871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.486019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50fa86-6a6a-4995-904f-6a96b44bca3f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.492774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.493598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.493868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.494150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.494825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.496971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.499925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c202d0-da48-40d6-b046-15b21556181c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.514853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 638/1272] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.514853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.515276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.515276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.515276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.515276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.515939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.520235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.525838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301550b-456f-4246-b7bc-0075898c3fe1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.531537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.532224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.532503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.532775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.533460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.536078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3430-b5cf-4711-9fea-64033ac4f1d7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.548996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 639/1273] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.550095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.550386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.554766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.555055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 635/1274] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.555055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.583022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261980e3-6d43-4115-abac-0460560e6c30 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.594425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.595682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.596327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.596896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.598268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.601643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.604185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:32.605473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:32.630971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 636/1275] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.633108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.655910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b17c-a221-4977-a62f-c6c8536e6050 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.664910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.665349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.665776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.666251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] PATH_INFO: `/v3/projects/6e9ea63d005d42d1b3d3d1b9111573e2/users/d82dae3c720643c8b62c9d2258f69f05/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.695511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9ea63d005d42d1b3d3d1b9111573e2, user_id=d82dae3c720643c8b62c9d2258f69f05, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.701628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.763525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 637/1276] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:32 2022] PUT /identity/v3/projects/6e9ea63d005d42d1b3d3d1b9111573e2/users/d82dae3c720643c8b62c9d2258f69f05/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:32.766056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.768188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 640/1277] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:32.769253 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:32.786811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21326-6c74-4de2-b6f1-bb143af1d59e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.819389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:32.948074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761a62-3fa6-4b94-a190-93a2fdae4396 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:32.960355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.961656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.962145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.962602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.963710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:32.966075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:32.969140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:32.970415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:32.970963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:32.971490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] PATH_INFO: `/v3/projects/cfebd22f91be42a7938ed6166cc8fb61/users/4fa389333d2a4ffe938dd78229d78ca8/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:32.988319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 638/1278] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:32.989911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.008163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfebd22f91be42a7938ed6166cc8fb61, user_id=4fa389333d2a4ffe938dd78229d78ca8, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.013919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.014495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b483-4e89-45cd-8c72-79a6673194e1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.030332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.034904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.036293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.037262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.039594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.045670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.053723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 641/1279] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:32 2022] PUT /identity/v3/projects/cfebd22f91be42a7938ed6166cc8fb61/users/4fa389333d2a4ffe938dd78229d78ca8/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:33.054975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.099027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 639/1280] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:33.106608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.127622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbd6-e109-4b1c-912a-4d4242631e5b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.166193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:33.228592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098637-1287-4a1d-81b1-9f84957c3acd admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.237460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.238812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.239297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.239872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.241105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.244543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fad9-79e1-4ec4-9ad5-8dc935d79f0f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.262025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 642/1281] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:33.264623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.265097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.265577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.279531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.280393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.280674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.280931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] PATH_INFO: `/v3/projects/332539f9e45341f2b5215138a78e8c55/users/e35bc05d950647809337ef28ab710e1b/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.317852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] RBAC: Authorizing `identity:create_grant(project_id=332539f9e45341f2b5215138a78e8c55, user_id=e35bc05d950647809337ef28ab710e1b, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.322998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.324993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] MFA Rules not processed for user `d82dae3c720643c8b62c9d2258f69f05`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:33.327389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:33.353199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 640/1282] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:33 2022] PUT /identity/v3/projects/332539f9e45341f2b5215138a78e8c55/users/e35bc05d950647809337ef28ab710e1b/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:33.354659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.585780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 643/1283] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:33.585780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.587539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe85d0-f554-48d0-8dc2-25ed7d16444b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.600060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.601210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.601677 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.602129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.602591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff0cb2-bb42-4b5d-be58-b48c72015071 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.665352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:33.726346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.729457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806f45-c065-4606-ac61-1a0d86f53394 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.753501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 641/1284] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:33.754455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.755183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.755462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.755738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] PATH_INFO: `/v3/projects/dfe93b0529e442ee878156b191ac47f8/users/c1f59b7199204abb921cf311bb789e4d/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.757179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.757467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.757746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.787730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:33.789387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:33.798676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe93b0529e442ee878156b191ac47f8, user_id=c1f59b7199204abb921cf311bb789e4d, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.804117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.804914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 642/1285] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:33.806110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.819750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414df66b-e9b9-40ec-9425-baf8fc6fb622 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:33.826840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:33.827441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.827774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.828101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] PATH_INFO: `/v3/projects/03cbd7f6ae1942b2a2d753cc8038f4cd/users/d756226bef274473ae1d75461487d062/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.850861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cbd7f6ae1942b2a2d753cc8038f4cd, user_id=d756226bef274473ae1d75461487d062, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:33.853892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4069ae-267e-4b7a-84b0-245a23b7e091 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:33.854259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 644/1286] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:33 2022] PUT /identity/v3/projects/dfe93b0529e442ee878156b191ac47f8/users/c1f59b7199204abb921cf311bb789e4d/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:33.856177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:33.892605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 643/1287] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:33 2022] PUT /identity/v3/projects/03cbd7f6ae1942b2a2d753cc8038f4cd/users/d756226bef274473ae1d75461487d062/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:33.895617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b4aa-20f3-4875-8940-5c9320ef8d35 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:33.896288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b4aa-20f3-4875-8940-5c9320ef8d35 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:33.897109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b4aa-20f3-4875-8940-5c9320ef8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:33.932531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:33.943601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7e59b4aa-20f3-4875-8940-5c9320ef8d35 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:33.951313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7e59b4aa-20f3-4875-8940-5c9320ef8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:33.978674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2406cb5-4a30-40d9-b0e6-b0a20a63cf7b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:34.075823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:34.077095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.077603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.078324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] PATH_INFO: `/v3/projects/2219120272eb4760b5ec37a735ecaa53/users/e2e9bd7bd9384c079e8d4bcfadbf08a4/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.102502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2219120272eb4760b5ec37a735ecaa53, user_id=e2e9bd7bd9384c079e8d4bcfadbf08a4, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:34.105297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63a04-356b-402d-bfe9-9b6fc54afce7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:34.118139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 644/1288] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.121696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacca08-0500-4502-ba0e-42d28f0d3fde None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.122299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacca08-0500-4502-ba0e-42d28f0d3fde None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.123551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacca08-0500-4502-ba0e-42d28f0d3fde None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.125850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 645/1289] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:48:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:48:34.126510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacca08-0500-4502-ba0e-42d28f0d3fde None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:34.140193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 645/1290] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:33 2022] PUT /identity/v3/projects/2219120272eb4760b5ec37a735ecaa53/users/e2e9bd7bd9384c079e8d4bcfadbf08a4/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:34.146068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576da57-7725-46c9-8ab3-d45decf59d98 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.147210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576da57-7725-46c9-8ab3-d45decf59d98 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.147210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576da57-7725-46c9-8ab3-d45decf59d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.218815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7576da57-7725-46c9-8ab3-d45decf59d98 None None] MFA Rules not processed for user `c1f59b7199204abb921cf311bb789e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:34.221054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7576da57-7725-46c9-8ab3-d45decf59d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:34.289285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacca08-0500-4502-ba0e-42d28f0d3fde None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:34.289607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:34.302532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:34.303296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.303625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.304112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.373068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 646/1291] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.374565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ccc8-18c3-44e2-83b6-4e02933783e3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.375756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ccc8-18c3-44e2-83b6-4e02933783e3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.375756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ccc8-18c3-44e2-83b6-4e02933783e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.421117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-58a1ccc8-18c3-44e2-83b6-4e02933783e3 None None] MFA Rules not processed for user `d756226bef274473ae1d75461487d062`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:34.422711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-58a1ccc8-18c3-44e2-83b6-4e02933783e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:34.441100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:34.444452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc83d84-a3c2-432c-a8ee-0d6b5260fe97 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:34.467540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 646/1292] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:34.469994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d704-d40c-499b-99fc-361ab7a6f533 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.470338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d704-d40c-499b-99fc-361ab7a6f533 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.470545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4d704-d40c-499b-99fc-361ab7a6f533 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.472954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 647/1293] 10.222.0.33 () {54 vars in 912 bytes} [Sat Oct 15 13:48:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:48:34.474338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4d704-d40c-499b-99fc-361ab7a6f533 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:34.495309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4d704-d40c-499b-99fc-361ab7a6f533 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:34.506936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:34.508462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.510323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.511073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.555655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 647/1294] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.557206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0208-d049-4524-95a4-525ba334e9d4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.557498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0208-d049-4524-95a4-525ba334e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.557776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0208-d049-4524-95a4-525ba334e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.574520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:34.577486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade7397-c2d3-4c86-bb27-7aee7125eeeb service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:34.592806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f5fa0208-d049-4524-95a4-525ba334e9d4 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:34.594307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f5fa0208-d049-4524-95a4-525ba334e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:34.618435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 648/1295] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:34.620716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.621204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.621704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.699002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:34.701453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:34.732625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 649/1296] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.739045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:34.768208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 648/1297] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.768440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82cb36-72e9-48b5-be49-5536e07786bb None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:34.770971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.771288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.771546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.779051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:34.780692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:34.782595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:34.783096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:34.784799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:34.792174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:34.825924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:34.827972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:34.846691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 650/1298] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:34.848267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:34.876997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:34.878771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 649/1299] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:34.882186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:34.915460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5600-948b-43a8-ae71-2e925f0ec375 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.011274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10732-e356-40d1-a944-4446b37b9ad4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.025519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.026290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.026625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.027095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.027636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.030801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.047910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:35.079738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.080419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.080737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.080965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.100629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.102322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.104027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 651/1300] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:34 2022] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:35.105139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:35.135262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 650/1301] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:35.136182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:35.159711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b87c-6711-4d36-ab56-ef3f0d3b463c service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.364965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.365704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.366089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.366352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.367161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.369380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.429113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 651/1302] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:35 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:35.433362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:35.593540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec6ad-fd28-4fe0-ac93-0aff13fe5fce admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.626901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.632274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.632583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.634023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.674592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e72f-4eab-4354-b8b1-3943ed30b291 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.702733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.703404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.703679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.703980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.736435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.738088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.787325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 652/1303] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:35.788281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:35.818056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd79f-1604-4b82-ad14-f7f2aae39201 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.840441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.842016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.842636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.843058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.848239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.850666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.907628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 653/1304] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:35 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:35.909115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:35.936582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd99-74d6-41e6-aad8-2fbd55744163 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:35.956002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:35.956899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:35.958317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:35.958969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:35.960595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.965325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:35.994285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:35.997037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.004138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 654/1305] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:36.005433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.034278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6aa27-d0ba-458e-bf3e-3545cbcc4399 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.036290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 652/1306] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 931 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:36.040517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.045894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.046795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.047243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.047691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.048552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.051044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.066730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d430-30c8-4228-a238-20a796fd74ad service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.083287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.086132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.087231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.088329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] PATH_INFO: `/v3/projects/30e8442dcc4f4dd9b49081084a787d20/users/4c3c03d0af994d48b5614129f11441af/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.099204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 655/1307] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:36.100880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.146854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338ff-9ed3-4319-87a8-3a64044ad19e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.160099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e8442dcc4f4dd9b49081084a787d20, user_id=4c3c03d0af994d48b5614129f11441af, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.173160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.174961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.175936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.176371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.176799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] PATH_INFO: `/v3/projects/ad5ad814a98043da9cc05d2cdba92586/users/3bf90b9860874cd5973fc77cc9a33996/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.218523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5ad814a98043da9cc05d2cdba92586, user_id=3bf90b9860874cd5973fc77cc9a33996, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.222205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.223405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 653/1308] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:36 2022] PUT /identity/v3/projects/30e8442dcc4f4dd9b49081084a787d20/users/4c3c03d0af994d48b5614129f11441af/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:36.229022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.265064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 656/1309] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:36 2022] PUT /identity/v3/projects/ad5ad814a98043da9cc05d2cdba92586/users/3bf90b9860874cd5973fc77cc9a33996/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:36.266426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.302806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:36.313638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:36.486908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5324-6e95-4f84-b507-6152066c5d8d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.500473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.501426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.503634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.504450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.505413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.508082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.553982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260e8a-7324-4714-b286-8a0eec23c8b6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.564556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 657/1310] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:36.573787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.580210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.581262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.581802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.582274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.587237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.589787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.612384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d154e-ce0b-4d57-b264-a3ea9aae6b60 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.620428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 654/1311] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:36.623374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:36.624343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.624486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.624693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] PATH_INFO: `/v3/projects/ad5ad814a98043da9cc05d2cdba92586/users/3bf90b9860874cd5973fc77cc9a33996/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.627012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:36.630320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5ad814a98043da9cc05d2cdba92586, user_id=3bf90b9860874cd5973fc77cc9a33996, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:36.633426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303f93-70e3-44fe-9531-3013e75588b9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:36.685421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 658/1312] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:36 2022] PUT /identity/v3/projects/ad5ad814a98043da9cc05d2cdba92586/users/3bf90b9860874cd5973fc77cc9a33996/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:36.696482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6a46e-af10-41d2-ba7e-2666ca2b7f87 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:36.703623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9379-6bc9-4a9f-9c57-3afd24bbe211 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:36.703623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9379-6bc9-4a9f-9c57-3afd24bbe211 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:36.705324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9379-6bc9-4a9f-9c57-3afd24bbe211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:36.895189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f89b9379-6bc9-4a9f-9c57-3afd24bbe211 None None] MFA Rules not processed for user `3bf90b9860874cd5973fc77cc9a33996`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:36.898364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f89b9379-6bc9-4a9f-9c57-3afd24bbe211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:37.035499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:37.038408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.039588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.042363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] PATH_INFO: `/v3/projects/30e8442dcc4f4dd9b49081084a787d20/users/4c3c03d0af994d48b5614129f11441af/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.047424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e8442dcc4f4dd9b49081084a787d20, user_id=4c3c03d0af994d48b5614129f11441af, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:37.051575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3291b-5caa-45f9-a9ce-29629dd7b487 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:37.100884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 655/1313] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:36 2022] PUT /identity/v3/projects/30e8442dcc4f4dd9b49081084a787d20/users/4c3c03d0af994d48b5614129f11441af/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:37.103895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694847-704f-4fbe-8987-482b45339627 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.104284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694847-704f-4fbe-8987-482b45339627 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.104496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694847-704f-4fbe-8987-482b45339627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.205258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-1e694847-704f-4fbe-8987-482b45339627 None None] MFA Rules not processed for user `4c3c03d0af994d48b5614129f11441af`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:37.211294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1e694847-704f-4fbe-8987-482b45339627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:37.227323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 659/1314] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:37.232807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d306-eeda-4794-bcd7-4c5e5c001176 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.233482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d306-eeda-4794-bcd7-4c5e5c001176 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.233936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d306-eeda-4794-bcd7-4c5e5c001176 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.236525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 660/1315] 10.222.0.33 () {54 vars in 912 bytes} [Sat Oct 15 13:48:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:48:37.249851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.252840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.253352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.368943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:37.370856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:37.600389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 661/1316] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:37.601631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:37.628754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 656/1317] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:37.665959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e694847-704f-4fbe-8987-482b45339627 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:37.678831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:37.827329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:37.918148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca0634-94e7-4332-baf9-b23c091efa98 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:37.931264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:37.932048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.932658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.932658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.943400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e694847-704f-4fbe-8987-482b45339627 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:37.960181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:37.961360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:37.961900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:37.962716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:37.984712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:37.988489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:38.014926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 657/1318] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:48:38.120600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:38.122702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:38.151071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 662/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:38.326032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:38.350039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f19-4dcc-49b6-ac0c-97e31d6d62a1 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:38.369395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:38.370397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:38.370801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:38.371289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:38.401191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:38.403983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d247e3-7ad3-40b5-8f04-f428b94f1ad5 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:38.448866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 658/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:40.707826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:40.963590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f3ff5-1f21-4542-8597-9fc0e89f2f53 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:40.975582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:40.977340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:40.978412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:40.979422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] PATH_INFO: `/v3/users/d756226bef274473ae1d75461487d062` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:40.987343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d756226bef274473ae1d75461487d062)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:40.990950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: WARNING py.warnings [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:48:40.990950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: warnings.warn(msg) Oct 15 13:48:40.990950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: Oct 15 13:48:40.994494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:41.352080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd756226bef274473ae1d75461487d062'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:41.437553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd756226bef274473ae1d75461487d062'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:41.438906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd756226bef274473ae1d75461487d062'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:41.440145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd756226bef274473ae1d75461487d062'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:41.466469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd756226bef274473ae1d75461487d062'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:41.495932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:41.565011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 663/1321] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:40 2022] DELETE /identity/v3/users/d756226bef274473ae1d75461487d062 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:41.571327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9f75-c681-41e0-b06f-8618a679f7e4 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:41.572408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9f75-c681-41e0-b06f-8618a679f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:41.572850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9f75-c681-41e0-b06f-8618a679f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:41.609230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-564c9f75-c681-41e0-b06f-8618a679f7e4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:41.610921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-564c9f75-c681-41e0-b06f-8618a679f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:41.755484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 659/1322] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:41.811700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:41.814012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:41.910256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df71ae-5c25-426a-ae0e-1fef9ddaac17 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:41.931571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:41.933129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:41.934123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:41.934524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:41.959566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:41.965639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64880a-e60d-45d4-8d78-8132c44ef2d4 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:42.010662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 664/1323] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:42.068264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:42.068264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:42.068264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:42.141172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] MFA Rules not processed for user `dc57e9716aa849a9864745592e920c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:42.142498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:42.311831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 660/1324] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:48:42.324823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:42.325230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:42.325507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:42.402311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] MFA Rules not processed for user `dc57e9716aa849a9864745592e920c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:42.404002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:42.426906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 665/1325] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:42.468069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:42.470132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:42.626864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:42.694809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468cff-c3e2-4a6c-a5f0-8fd54bae61a5 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:42.728581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:42.731688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:42.733805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:42.735303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:42.775973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:42.775973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:42.797341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:42.800819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea96229-cf2a-44c9-86a1-8a80f3515a55 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:42.820792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace916-6f44-41a9-b911-4d7efb7c3f6b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:42.830744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:42.838879 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:42.839912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:42.840693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] PATH_INFO: `/v3/users/d82dae3c720643c8b62c9d2258f69f05` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:42.842457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82dae3c720643c8b62c9d2258f69f05)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:42.844954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:42.865465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 661/1326] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:42.950621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82dae3c720643c8b62c9d2258f69f05'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:42.979127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82dae3c720643c8b62c9d2258f69f05'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:42.979127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82dae3c720643c8b62c9d2258f69f05'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:42.991637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82dae3c720643c8b62c9d2258f69f05'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.004539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82dae3c720643c8b62c9d2258f69f05'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.043556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 666/1327] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:42 2022] DELETE /identity/v3/users/d82dae3c720643c8b62c9d2258f69f05 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:43.047872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:43.047872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:43.048310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:43.078262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:43.078262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:43.089520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:43.101797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:43.271942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:43.319626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 662/1328] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:43.347040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667a8f-fa07-4afd-8178-4c201968a79b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:43.364287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:43.365014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:43.365551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:43.366019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] PATH_INFO: `/v3/users/9fb93332b7e54ca78eb51566343fca16` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:43.367655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb93332b7e54ca78eb51566343fca16)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:43.369909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:43.520105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb93332b7e54ca78eb51566343fca16'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.557986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb93332b7e54ca78eb51566343fca16'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.562150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb93332b7e54ca78eb51566343fca16'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.563155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb93332b7e54ca78eb51566343fca16'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.585665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:43.587150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:43.593149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b74bf5d7-9777-4cc6-b341-dcc3d661246f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb93332b7e54ca78eb51566343fca16'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:43.663957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 667/1329] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:43 2022] DELETE /identity/v3/users/9fb93332b7e54ca78eb51566343fca16 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:48:43.672086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:43.673457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:43.673802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:43.736993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:43.740095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:43.765388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f059-fc86-46fb-8d62-51345108dc69 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:43.932681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:43.933319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:43.933659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:43.934056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:43.939056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.006016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 668/1330] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:44.008315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:44.013175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.053030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb0331-c586-413d-98a0-ac184b8227f9 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:44.067691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:44.071544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:44.073517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:44.074030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:44.074576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] PATH_INFO: `/v3/projects/03cbd7f6ae1942b2a2d753cc8038f4cd` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:44.080564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cbd7f6ae1942b2a2d753cc8038f4cd)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:44.087258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:44.100234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:44.102697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:44.150580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 663/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:48:44.152253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:44.157031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.197457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66580-be55-41dd-9aed-4d3bd9bd24ae service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:44.203201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:44.204519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:44.205129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:44.205621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:44.219041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:44.220977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:44.252051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 664/1332] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:44.253019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:44.265549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.299561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373dc9-36e1-4a15-9cf4-ef00287fbe0a service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:44.314497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cbd7f6ae1942b2a2d753cc8038f4cd', 'request_id': 'req-69e59c3a-fa4b-4729-827b-48071d4d8603'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.345605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cbd7f6ae1942b2a2d753cc8038f4cd', 'request_id': 'req-69e59c3a-fa4b-4729-827b-48071d4d8603'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.376392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cbd7f6ae1942b2a2d753cc8038f4cd', 'request_id': 'req-69e59c3a-fa4b-4729-827b-48071d4d8603'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.381134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:44.405148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] The token cache is being invalidate because project 03cbd7f6ae1942b2a2d753cc8038f4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:44.406795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.409294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.412798 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 669/1333] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:44 2022] DELETE /identity/v3/projects/03cbd7f6ae1942b2a2d753cc8038f4cd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:44.420631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:44.424169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.476076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:44.476820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:44.477108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:44.477399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] PATH_INFO: `/v3/users/c1f59b7199204abb921cf311bb789e4d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:44.482801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f59b7199204abb921cf311bb789e4d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:44.484983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:44.603612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f59b7199204abb921cf311bb789e4d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.622359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f59b7199204abb921cf311bb789e4d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.624116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f59b7199204abb921cf311bb789e4d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.624847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f59b7199204abb921cf311bb789e4d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.638216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0e35a4b0-da81-4290-9baa-703a60f9aaa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f59b7199204abb921cf311bb789e4d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.657712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59c3a-fa4b-4729-827b-48071d4d8603 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:44.679544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 665/1334] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:44 2022] DELETE /identity/v3/users/c1f59b7199204abb921cf311bb789e4d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:44.680151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:44.680151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:44.681023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:44.682410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fee39-3ea8-4d0d-b8fb-1f1d19df52b5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:44.682760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fee39-3ea8-4d0d-b8fb-1f1d19df52b5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:44.682971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] PATH_INFO: `/v3/users/3bf90b9860874cd5973fc77cc9a33996` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:44.683767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fee39-3ea8-4d0d-b8fb-1f1d19df52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:44.687806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf90b9860874cd5973fc77cc9a33996)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:44.697770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:44.766410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-989fee39-3ea8-4d0d-b8fb-1f1d19df52b5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:44.772744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-989fee39-3ea8-4d0d-b8fb-1f1d19df52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:44.932875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:44.945066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf90b9860874cd5973fc77cc9a33996'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.980466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 666/1335] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:48:44.985752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf90b9860874cd5973fc77cc9a33996'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.988285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf90b9860874cd5973fc77cc9a33996'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:44.993263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf90b9860874cd5973fc77cc9a33996'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:45.022796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf90b9860874cd5973fc77cc9a33996'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:45.087863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 670/1336] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:44 2022] DELETE /identity/v3/users/3bf90b9860874cd5973fc77cc9a33996 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:45.337331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf35e-01a6-43e2-abc3-0cd1bf574a90 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:45.337778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf35e-01a6-43e2-abc3-0cd1bf574a90 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:45.338144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf35e-01a6-43e2-abc3-0cd1bf574a90 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:45.340216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 667/1337] 10.222.0.33 () {54 vars in 912 bytes} [Sat Oct 15 13:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:48:45.342868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:45.344852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:45.348830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:45.349905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:45.350305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:45.459969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:45.462000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:45.533194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c802-fa66-41c8-a0a9-b019113d7680 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:45.541975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:45.542906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:45.543417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:45.543962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:45.548814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:45.596385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:45.613212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 668/1338] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:45.616634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:45.618578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:45.724239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:45.730274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:45.755398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 671/1339] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:45.772408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493d3f0-d398-44aa-a7b6-6de22544c358 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:45.778278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:45.779041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:45.779326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:45.779601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] PATH_INFO: `/v3/projects/72ff9afb91e44b1787cb6ed31fc7f6d9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:45.782043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ff9afb91e44b1787cb6ed31fc7f6d9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:45.783132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: WARNING py.warnings [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 13:48:45.783132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: warnings.warn(msg) Oct 15 13:48:45.783132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: Oct 15 13:48:45.785287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:45.825820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:45.843393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0944-a384-4090-8f07-9ad559a14ea3 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:45.867239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:45.868244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:45.868684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:45.869041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:45.894818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:45.896730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560a174-efb6-46a4-b3c6-8ef39bdeab3d service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:45.923062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 672/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:45.947429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ff9afb91e44b1787cb6ed31fc7f6d9', 'request_id': 'req-5e0441cd-6229-4a18-8935-b50d29affaae'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:45.969459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ff9afb91e44b1787cb6ed31fc7f6d9', 'request_id': 'req-5e0441cd-6229-4a18-8935-b50d29affaae'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.008390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ff9afb91e44b1787cb6ed31fc7f6d9', 'request_id': 'req-5e0441cd-6229-4a18-8935-b50d29affaae'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.030932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] The token cache is being invalidate because project 72ff9afb91e44b1787cb6ed31fc7f6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:46.031269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.032037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5e0441cd-6229-4a18-8935-b50d29affaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.035318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 669/1341] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:45 2022] DELETE /identity/v3/projects/72ff9afb91e44b1787cb6ed31fc7f6d9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:46.040453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.041078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.041078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.080193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:46.081498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:46.257943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 673/1342] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:46.277044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.277838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.280217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.377515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:46.378858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:46.415687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 670/1343] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:46.417604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:46.434437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7851962-af7d-43e8-aa46-16d780b32b94 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:46.449962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:46.450632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.451024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.451433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.452038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:46.452368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:46.454098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:46.466790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:46.468865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:46.484433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 674/1344] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:46.491456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:46.493279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5292f70-e006-4a2d-bb29-57241d616328 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:46.506438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:46.507115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.507393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.507661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] PATH_INFO: `/v3/projects/6e9ea63d005d42d1b3d3d1b9111573e2` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.508852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbab09-6d50-4253-881c-01b5559ed8cf admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:46.509050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9ea63d005d42d1b3d3d1b9111573e2)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:46.510932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:46.513306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:46.523470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:46.524389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.524389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.525319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.526050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:46.528338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:46.609477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 675/1345] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:46 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:48:46.616358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:46.654113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9ea63d005d42d1b3d3d1b9111573e2', 'request_id': 'req-4bac221f-07d6-4a88-8894-876abcbb6f39'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.689371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9ea63d005d42d1b3d3d1b9111573e2', 'request_id': 'req-4bac221f-07d6-4a88-8894-876abcbb6f39'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.700968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9ea63d005d42d1b3d3d1b9111573e2', 'request_id': 'req-4bac221f-07d6-4a88-8894-876abcbb6f39'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.745966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] The token cache is being invalidate because project 6e9ea63d005d42d1b3d3d1b9111573e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:46.746917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.748168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4bac221f-07d6-4a88-8894-876abcbb6f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:46.750893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 671/1346] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:46 2022] DELETE /identity/v3/projects/6e9ea63d005d42d1b3d3d1b9111573e2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:48:46.758355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac250c7-c8d0-489f-a4b4-e84cb71b6ffa None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.759033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac250c7-c8d0-489f-a4b4-e84cb71b6ffa None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.759529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac250c7-c8d0-489f-a4b4-e84cb71b6ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.804438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4ac250c7-c8d0-489f-a4b4-e84cb71b6ffa None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:46.807301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4ac250c7-c8d0-489f-a4b4-e84cb71b6ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:46.869533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184edb8-364b-4ed3-a7f8-f6e0a891ca98 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:46.889089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:46.889877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:46.890151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:46.890518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:46.891267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:46.894887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:46.941478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 676/1347] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:46 2022] POST /identity/v3/users => generated 303 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:46.961122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:46.965930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:46.991471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 672/1348] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:47.003346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.003695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.003942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.007344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:47.016199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf73a-ce64-497d-9474-78435e7bcf2d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.026293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.027092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.027619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.028372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.029296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.031393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.051045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 677/1349] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:47.055325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.058984 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:47.061372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:47.078204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea358-0f05-4940-80aa-602c8de5ea78 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.092075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.093272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.093906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.094484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.095571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.098425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.104705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 673/1350] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:47.108762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.137019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 678/1351] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:47.138797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.144858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e38d3a-717a-42d8-af02-391d06465c9d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.165890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd6d83-91e5-45b1-8753-dbe54cd628c2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.174218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.174822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.175383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.175566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.175861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] PATH_INFO: `/v3/projects/e23b7a532cf24ac29e0c624a4ba738fd/users/460fb17e10e74b0599cabf79d7309014/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.177417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.178212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.180099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.188485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:47.189821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.201351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.217037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23b7a532cf24ac29e0c624a4ba738fd, user_id=460fb17e10e74b0599cabf79d7309014, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.222899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.259885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 679/1352] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:47 2022] PUT /identity/v3/projects/e23b7a532cf24ac29e0c624a4ba738fd/users/460fb17e10e74b0599cabf79d7309014/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:47.269578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.270083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 674/1353] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:47.274264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.279354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:47.328224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd64c1a-ace6-46d2-81b1-ae0dad1c9938 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.516035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606eaf-e7b5-46c2-b83e-bf5d49c6d851 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:47.535964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.536712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.537032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.537306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] PATH_INFO: `/v3/projects/ad5ad814a98043da9cc05d2cdba92586` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.539524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5ad814a98043da9cc05d2cdba92586)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.541605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.568955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:47.569641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.569993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.570168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.570847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:47.572920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9411532-cfc5-4ffc-860c-5b97ec716925 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:47.613369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:47.643134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 675/1354] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:47 2022] POST /identity/v3/projects => generated 363 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:47.644916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:47.648098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:47.648563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:47.669806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5ad814a98043da9cc05d2cdba92586', 'request_id': 'req-2d7e5825-5481-47c1-ab40-7b3554ebff13'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:47.688184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5ad814a98043da9cc05d2cdba92586', 'request_id': 'req-2d7e5825-5481-47c1-ab40-7b3554ebff13'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:47.710795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5ad814a98043da9cc05d2cdba92586', 'request_id': 'req-2d7e5825-5481-47c1-ab40-7b3554ebff13'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:47.757301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] MFA Rules not processed for user `460fb17e10e74b0599cabf79d7309014`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:47.763952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:47.764973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] The token cache is being invalidate because project ad5ad814a98043da9cc05d2cdba92586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:47.766784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:47.782330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:47.785355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 680/1355] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:47 2022] DELETE /identity/v3/projects/ad5ad814a98043da9cc05d2cdba92586 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:47.786483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.798074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:47.929590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:47.965216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 676/1356] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:47.977570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:47.979444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:47.992939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5825-5481-47c1-ab40-7b3554ebff13 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:48.085889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7401ac-8bca-4ada-bfb6-538debc46375 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:48.092276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:48.092927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.093207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.093487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.094351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:48.097013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72228-a232-439e-8980-d14edd8350ef admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:48.129388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 677/1357] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:47 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:48.134672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.134965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.135388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.136532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:48.138746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.139192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.140315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] PATH_INFO: `/v3/projects/dfe93b0529e442ee878156b191ac47f8` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.142063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe93b0529e442ee878156b191ac47f8)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:48.145562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:48.161961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:48.163123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.184141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 678/1358] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:48.188925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:48.191112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.261441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe93b0529e442ee878156b191ac47f8', 'request_id': 'req-0cb4bec9-415c-4dde-b528-52008e8872d0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:48.271590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe93b0529e442ee878156b191ac47f8', 'request_id': 'req-0cb4bec9-415c-4dde-b528-52008e8872d0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:48.287956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe93b0529e442ee878156b191ac47f8', 'request_id': 'req-0cb4bec9-415c-4dde-b528-52008e8872d0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:48.318878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] The token cache is being invalidate because project dfe93b0529e442ee878156b191ac47f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:48.319373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:48.320408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:48.326277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 681/1359] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:47 2022] DELETE /identity/v3/projects/dfe93b0529e442ee878156b191ac47f8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:48.327872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:48.329759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.451637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bec9-415c-4dde-b528-52008e8872d0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:48.466700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4a74-7959-4103-84d4-6c3d05fae55f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:48.470109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:48.470783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.471064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.471337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.473635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:48.477340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b5e9-9eb5-4572-878e-ae68991dfdf9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:48.515195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:48.560205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 682/1360] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:48 2022] POST /identity/v3/projects => generated 403 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:48.560205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.560205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.560205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.612703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] MFA Rules not processed for user `dc57e9716aa849a9864745592e920c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:48.614080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.625310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:48.760903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 683/1361] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:48.761999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:48.764818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.790286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:48.792125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.792860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.793877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.800048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:48.897168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:48.929246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596158-4fc1-499c-b629-ea5dea9f40ef service placement] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:48.968711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc80ecb-cdc0-458c-b91b-e5243129f005 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:48.986740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:48.987400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:48.987688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:48.987878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 679/1362] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:48.988325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:48.990617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:48.995358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.000300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.010601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.011241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.038708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 684/1363] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:49.041303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.051012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:49.073983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f351b-26da-4756-b0fb-1c2d06877a2a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.101982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.102665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.102941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.104119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] PATH_INFO: `/v3/users/4c3c03d0af994d48b5614129f11441af` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.108892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3c03d0af994d48b5614129f11441af)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:49.111414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.119811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:49.122577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:49.166695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 680/1364] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:49.168666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.207089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0161b-681d-4b35-a9b5-f58bb88b5409 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.220562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.223000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.224000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.224822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.226548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:49.231077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.238505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3c03d0af994d48b5614129f11441af'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:49.259274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3c03d0af994d48b5614129f11441af'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:49.260781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3c03d0af994d48b5614129f11441af'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:49.261884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3c03d0af994d48b5614129f11441af'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:49.289939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3c03d0af994d48b5614129f11441af'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:49.320166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 681/1365] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:49 2022] POST /identity/v3/users => generated 308 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:49.325611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.334739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:49.336446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 685/1366] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:49 2022] DELETE /identity/v3/users/4c3c03d0af994d48b5614129f11441af => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:49.338958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.340047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:49.401652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:49.404256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b728b0-1027-4722-aaae-028e2a3c4516 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.628878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c861-5601-491f-b855-80d83aff6fd5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.661400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.662513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.663086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.665033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.666473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:49.681897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:49.690366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.759729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 686/1367] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:49.777632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.787290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:49.801583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.805465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.805915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.808982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.817097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:49.828493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.859827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511582-e1c2-49e6-9de5-da24508d8b99 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.881062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.882190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.882713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.883639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:49.885313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:49.891125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:49.945326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 682/1368] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 619 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:49.946806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.955582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 687/1369] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:49.958116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:49.978958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b390-79cc-4246-9ce4-d5ef5dab6715 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:49.988542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:49.989583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:49.991479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:49.992033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] PATH_INFO: `/v3/projects/536899df91d0402b9548341149659a26/users/7365db7a76a24e13a33d199c4b7d0e27/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:50.014876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8217725-aa1d-49f7-8b28-f15e7891acca admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:50.038543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] RBAC: Authorizing `identity:create_grant(project_id=536899df91d0402b9548341149659a26, user_id=7365db7a76a24e13a33d199c4b7d0e27, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:50.046423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:50.047454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:50.048240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:50.052485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:50.052982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:50.064455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:50.085812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e89d8-5882-4baa-a63a-ac63e207e69f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:50.097781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 688/1370] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:49 2022] PUT /identity/v3/projects/536899df91d0402b9548341149659a26/users/7365db7a76a24e13a33d199c4b7d0e27/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:50.099108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:50.331142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 683/1371] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:49 2022] POST /identity/v3/projects => generated 365 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:50.336510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:50.336996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:50.341804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:50.360898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5b6e-0127-4d8b-8576-ee4772ff856b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:50.535431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:50.537523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] MFA Rules not processed for user `7365db7a76a24e13a33d199c4b7d0e27`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:50.539672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:50.541764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:50.542053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:50.543833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] PATH_INFO: `/v3/projects/abca6a3653b04060a198e6b0b59962e2/users/41dc91d36442473a80ac90af220ce160/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:50.606998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=abca6a3653b04060a198e6b0b59962e2, user_id=41dc91d36442473a80ac90af220ce160, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:50.638150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:50.682147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 689/1372] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:50 2022] PUT /identity/v3/projects/abca6a3653b04060a198e6b0b59962e2/users/41dc91d36442473a80ac90af220ce160/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:50.683033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:50.700050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:50.731677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:50.787705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 684/1373] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:50.789071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:50.859941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a9fa-48ab-449a-8811-5db97fd129b6 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:50.958835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b73bd-3e8d-4db7-befe-87ac62570aca admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:50.970644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:50.974745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:50.975077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:50.975297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:50.976043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:50.979871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:51.023019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:51.023676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:51.027725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:51.028181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:51.028925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:51.030689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:51.062147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 690/1374] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:50 2022] POST /identity/v3/users => generated 283 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:51.078548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:51.089729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 685/1375] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:51.091858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:51.093080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:51.189820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ea7c2-f1e9-435a-afe6-4605ad657247 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:51.237470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:51.238540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:51.239031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:51.240528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:51.240791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:51.243828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:51.330007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 686/1376] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:51.331509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:51.402828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced183-d3f4-47f6-ba3c-413b252bcf65 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:51.436980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:51.452617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:51.453203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:51.455890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] PATH_INFO: `/v3/projects/abca6a3653b04060a198e6b0b59962e2/users/41dc91d36442473a80ac90af220ce160/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:51.465434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abca6a3653b04060a198e6b0b59962e2, user_id=41dc91d36442473a80ac90af220ce160, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:51.493149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:51.520287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b06e5-3eac-474f-9746-9a9767c5e8b5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:51.555596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 687/1377] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:51 2022] PUT /identity/v3/projects/abca6a3653b04060a198e6b0b59962e2/users/41dc91d36442473a80ac90af220ce160/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:51.557791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:51.751020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:51.751701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:51.752016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:51.752293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:51.925146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:51.926771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa77a-f6b4-4f59-a884-af6921869143 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:51.953679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 691/1378] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 891 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:51.955917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:51.956335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:51.959424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:52.007660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:52.041104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] MFA Rules not processed for user `41dc91d36442473a80ac90af220ce160`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:52.042511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:52.056533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd365-364c-469a-9416-0ace05450ed2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:52.076951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:52.078756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:52.080832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:52.080832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:52.090077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:52.104303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:52.181513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 688/1379] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 623 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:52.184838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:52.196439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:52.241009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 692/1380] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:52.241009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:52.271162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be67ff-2dbe-4d64-a8db-0d2c7f29df8e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:52.299814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:52.300098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:52.300196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:52.300610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] PATH_INFO: `/v3/projects/682e10da37b946b7a7d4befd72a4189b/users/d945c7888c52453abd1307f89a450a65/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:52.308143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a77e-d276-4b6d-9236-45b0d00e4e8d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:52.343693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:52.344894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:52.346371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:52.346908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] PATH_INFO: `/v3/projects/30e8442dcc4f4dd9b49081084a787d20` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:52.352347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e8442dcc4f4dd9b49081084a787d20)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:52.361418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:52.379477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=682e10da37b946b7a7d4befd72a4189b, user_id=d945c7888c52453abd1307f89a450a65, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:52.384187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:52.430176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 693/1381] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:52 2022] PUT /identity/v3/projects/682e10da37b946b7a7d4befd72a4189b/users/d945c7888c52453abd1307f89a450a65/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:52.437209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:52.442535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:52.540626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:52.557649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e8442dcc4f4dd9b49081084a787d20', 'request_id': 'req-2166b395-ce68-4a70-95f8-4fd83b3a4b87'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:52.585164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e8442dcc4f4dd9b49081084a787d20', 'request_id': 'req-2166b395-ce68-4a70-95f8-4fd83b3a4b87'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:52.608601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e8442dcc4f4dd9b49081084a787d20', 'request_id': 'req-2166b395-ce68-4a70-95f8-4fd83b3a4b87'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:52.678780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] The token cache is being invalidate because project 30e8442dcc4f4dd9b49081084a787d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:52.681315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:52.683937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2166b395-ce68-4a70-95f8-4fd83b3a4b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:52.697049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 689/1382] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:52 2022] DELETE /identity/v3/projects/30e8442dcc4f4dd9b49081084a787d20 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:52.702127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14553-0d04-4fdc-8b6e-359bd585e142 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:52.702954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14553-0d04-4fdc-8b6e-359bd585e142 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:52.706428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14553-0d04-4fdc-8b6e-359bd585e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:52.756191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eea6ea-fac8-448e-8b97-cd081e39c07c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:52.871515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-16d14553-0d04-4fdc-8b6e-359bd585e142 None None] MFA Rules not processed for user `e35bc05d950647809337ef28ab710e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:52.881521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-16d14553-0d04-4fdc-8b6e-359bd585e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.040179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:53.041195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:53.041571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:53.043751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:53.049002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.147065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:53.253997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:53.253997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feec297-b99a-41f5-978b-07bdc2cef0a3 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:53.288701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 694/1383] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:53.290434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfe33-5d59-41a3-945b-5d6678a860cf None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:53.296516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfe33-5d59-41a3-945b-5d6678a860cf None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:53.297681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfe33-5d59-41a3-945b-5d6678a860cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:53.322815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 690/1384] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:53.331405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:53.338475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:53.339109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:53.405963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-18acfe33-5d59-41a3-945b-5d6678a860cf None None] MFA Rules not processed for user `d945c7888c52453abd1307f89a450a65`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:53.411746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-18acfe33-5d59-41a3-945b-5d6678a860cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.440133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:53.446941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.756533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 691/1385] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:53.759201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:53.761657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 695/1386] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:53.764312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:53.766036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:53.766036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:53.769152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.828074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:53.830331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.854168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 696/1387] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:53.854935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:53.858729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:53.890388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeee09-232c-4320-bf62-696bd76fa484 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:53.910671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:53.914780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:53.915531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:53.916440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:53.922536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:53.929411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:54.007735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 697/1388] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:53 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:54.010703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:54.017300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:54.164779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:54.204627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867e6ed-6795-4692-af00-7bf7e5918d06 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:54.254810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f6c4c-c204-4ed1-ae47-e5544d2a9498 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:54.284857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:54.285721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:54.286008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:54.286434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] PATH_INFO: `/v3/users/460fb17e10e74b0599cabf79d7309014` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:54.289294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460fb17e10e74b0599cabf79d7309014)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:54.297249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:54.462640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:54.495386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460fb17e10e74b0599cabf79d7309014'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:54.537045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460fb17e10e74b0599cabf79d7309014'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:54.542470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460fb17e10e74b0599cabf79d7309014'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:54.544539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460fb17e10e74b0599cabf79d7309014'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:54.579600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460fb17e10e74b0599cabf79d7309014'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:54.615517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:54.617625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:54.618286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:54.619054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:54.640622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:54.744304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 698/1389] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:54 2022] DELETE /identity/v3/users/460fb17e10e74b0599cabf79d7309014 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:54.748460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:54.753810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:54.897315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:54.909735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:54.959454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 692/1390] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 1199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:54.961370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:54.973928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:55.001601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95c9d-e14c-4565-bdad-6b11a6459b12 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:55.027750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:55.028865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.029322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.029788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.037966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:48:55.038587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:55.041570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3161be-dd0b-4699-8834-5e57063a4130 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:55.044244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db08cd-d1af-472a-8a76-9a576b271527 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:55.075624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:55.077208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.077963 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.078755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.080244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:55.084465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:55.126258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 699/1391] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:48:55.131544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.133920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.135249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.157140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 693/1392] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:54 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:55.164534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:55.212761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b30-a351-4eb5-9ad3-46325bfb77e3 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:55.266480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:55.272219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:55.272219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.272973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.273539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.273847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:55.274881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:55.284939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa40478-8d8c-415f-9724-e77dd72481ab admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:55.345162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 700/1393] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:55.349963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:55.410587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 694/1394] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:55 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:55.412532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.413065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.413465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.420510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3571f-7056-4f95-a753-45f1ff23ae1a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:55.654481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:55.659997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:55.698470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:55.702091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.703706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.705210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.708802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:55.716948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:55.790127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 701/1395] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:55.791488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:55.839330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:55.882274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade26-2e54-4ee8-bcff-64a84320e292 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:55.917228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:55.931843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:55.931843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:55.931843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:55.931843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:55.931843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.023632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 695/1396] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 612 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:56.026044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.027202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 702/1397] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:55 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:56.028658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.033294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:56.070273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ceb9-9043-477a-a615-3c804f56a12b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.088187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.089039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.089352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.090276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] PATH_INFO: `/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4/users/d028e69e08044026815030db846d60fb/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.150060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da2cea8bf0b4bcfa012cb0f9ca37fc4, user_id=d028e69e08044026815030db846d60fb, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.153543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.223512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:56.235774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 703/1398] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:56 2022] PUT /identity/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4/users/d028e69e08044026815030db846d60fb/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:56.243225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.302792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc7bf7-5eee-45a7-9411-b4017dc2db69 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.558014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.559535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.560882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.561389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.564784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4937cf-39fc-4e46-9dcf-bfa7cb2557be admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.598105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.600043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.600919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.601344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.602655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.604548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.610767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.612306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.656507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 696/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:56.657384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 704/1400] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:56.658474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.661036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.671973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:56.687825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a934c3-616f-48ad-8fb7-89e3653ea2d5 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.701471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.703325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.704274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.704987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.706478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.710108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.736202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 697/1401] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:56.738348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.783551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709031-4b56-482f-8a01-f1567c70c6b6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.810832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.815232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.816395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.817748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.819825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.830578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:56.901138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 698/1402] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:56.903538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:56.952159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556a8a-f236-41d6-bb0b-ef96ae9d2ed4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:56.963198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:56.965153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:56.965820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:56.966479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] PATH_INFO: `/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4/users/d028e69e08044026815030db846d60fb/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:56.971139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da2cea8bf0b4bcfa012cb0f9ca37fc4, user_id=d028e69e08044026815030db846d60fb, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:56.978437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:57.006775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 699/1403] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:56 2022] PUT /identity/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4/users/d028e69e08044026815030db846d60fb/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:57.008412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:57.055718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47bb5-821c-4ad9-827b-8ff1ea26bdf8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:57.229876 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:57.232605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:57.233643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:57.234032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:57.262745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:57.310316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b1ff-fa19-478a-b1ed-d9169b43f0a7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:57.331468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:57.351465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:57.353686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:57.353686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:57.353686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] PATH_INFO: `/v3/projects/4a87bafe6d964d298987ac892f075e92/users/6a75178408934490be5ed669ec3da6e0/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:57.445505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a87bafe6d964d298987ac892f075e92, user_id=6a75178408934490be5ed669ec3da6e0, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:57.471495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cda1b-fc13-469f-aa4c-7de3ff56b140 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:57.571525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 700/1404] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:57 2022] PUT /identity/v3/projects/4a87bafe6d964d298987ac892f075e92/users/6a75178408934490be5ed669ec3da6e0/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:57.572413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:57.574890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:57.575112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:57.671363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:57.673160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819b85f-b758-4c6d-8b82-65d7961e4320 service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:57.703846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 705/1405] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:48:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1046 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:57.705300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:57.705583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:57.705856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:57.846884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] MFA Rules not processed for user `6a75178408934490be5ed669ec3da6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:57.848311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:57.878169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] MFA Rules not processed for user `d028e69e08044026815030db846d60fb`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:48:57.882031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:58.294232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 701/1406] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 731 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:58.298651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 706/1407] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:48:58.298651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:58.300991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:58.312466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:58.630058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2382-2092-4cd2-9c8b-bc65414d4efe None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:58.658198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:58.659296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:58.659857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:58.660340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:58.661534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:58.677444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:58.733705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8e67-75f9-4be0-befa-0ad0565a127f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:58.747520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:58.753190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:58.754015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:58.754325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:58.789583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:58.795450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:58.819717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 702/1408] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:48:58 2022] POST /identity/v3/projects => generated 387 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:58.835893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:58.840771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 707/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:59.074052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:59.091277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:59.104040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26d0b-ee2b-420e-b97d-ed01afeeda5d service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:59.154008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbe4ad-057c-4d67-ab9e-d834aaba7b81 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:59.182318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:59.185541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:59.188511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:59.190391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:59.195923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:59.209035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:59.314138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 703/1410] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:48:58 2022] POST /identity/v3/users => generated 300 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:48:59.314988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:59.314988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:59.314988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:59.314988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:59.319191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:59.323445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:59.343172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:59.345191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f4608-e453-42d5-9756-9b186768aba7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:59.361649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:59.364259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:59.365085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:59.367558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:59.369376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:59.371678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:59.403964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 704/1411] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:48:59.405466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:59.426543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:59.489605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102598-37a0-4650-913f-5bfaa677bfe7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:59.505636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:59.506348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:59.506601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:59.508782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] PATH_INFO: `/v3/projects/e23b7a532cf24ac29e0c624a4ba738fd` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:48:59.512565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23b7a532cf24ac29e0c624a4ba738fd)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:59.521401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:59.550404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:48:59.556238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:48:59.602035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 708/1412] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:48:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:48:59.603079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:59.668147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23b7a532cf24ac29e0c624a4ba738fd', 'request_id': 'req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:59.672273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b66e30-66b6-4dcb-a7fd-64483bd97314 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:48:59.684424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23b7a532cf24ac29e0c624a4ba738fd', 'request_id': 'req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:59.755819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23b7a532cf24ac29e0c624a4ba738fd', 'request_id': 'req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:59.843265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] The token cache is being invalidate because project e23b7a532cf24ac29e0c624a4ba738fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:48:59.843661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:59.846315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:48:59.849426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 705/1413] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:48:59 2022] DELETE /identity/v3/projects/e23b7a532cf24ac29e0c624a4ba738fd => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:48:59.860378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:48:59.885623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:48:59.985372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:48:59.986670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:48:59.987170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:48:59.987916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] PATH_INFO: `/v3/projects/cf0ee10325eb4776817f16bf312d5731/users/63d11d3fcdef4c79939eb3950e31872f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:00.083462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0ee10325eb4776817f16bf312d5731, user_id=63d11d3fcdef4c79939eb3950e31872f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:00.089018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:00.178844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 709/1414] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:48:59 2022] PUT /identity/v3/projects/cf0ee10325eb4776817f16bf312d5731/users/63d11d3fcdef4c79939eb3950e31872f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:00.186182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:00.201458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:00.337231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d804-887c-4ae8-a653-0b6394ed1fb3 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:00.597764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133461b-fdc4-483f-87bf-9d92b8e72df8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:00.632179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:00.633290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:00.633748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:00.634226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:00.635507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:00.638915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:00.675271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:00.749325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:00.750203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:00.750676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:00.751131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] PATH_INFO: `/v3/users/41dc91d36442473a80ac90af220ce160` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:00.772625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dc91d36442473a80ac90af220ce160)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:00.780645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 710/1415] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:49:00.782308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:00.799844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:00.837410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863452cc-00f2-46fc-ae95-bee61db3458c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:00.872572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:00.873716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:00.874242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:00.874738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] PATH_INFO: `/v3/projects/cf0ee10325eb4776817f16bf312d5731/users/63d11d3fcdef4c79939eb3950e31872f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:00.885675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0ee10325eb4776817f16bf312d5731, user_id=63d11d3fcdef4c79939eb3950e31872f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:00.891451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5edaf5-c598-449a-b59d-ef4f91c23397 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:00.992214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 711/1416] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:00 2022] PUT /identity/v3/projects/cf0ee10325eb4776817f16bf312d5731/users/63d11d3fcdef4c79939eb3950e31872f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:01.017562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:01.018176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:01.018651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:01.066097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dc91d36442473a80ac90af220ce160'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:01.091614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dc91d36442473a80ac90af220ce160'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:01.095262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dc91d36442473a80ac90af220ce160'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:01.100557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dc91d36442473a80ac90af220ce160'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:01.146520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dc91d36442473a80ac90af220ce160'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:01.191732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:01.226848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] MFA Rules not processed for user `63d11d3fcdef4c79939eb3950e31872f`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:01.226848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:01.242590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 706/1417] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:48:59 2022] DELETE /identity/v3/users/41dc91d36442473a80ac90af220ce160 => generated 0 bytes in 1387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:01.532457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 712/1418] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:01.547279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:01.549926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:01.794778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352725f-4d7d-4fa3-b3e0-8816279a6974 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:01.817853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:01.819039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:01.819520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:01.830717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:02.228067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:02.230278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f798bb-5da2-4695-94d1-f96c74fc6a48 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:02.250738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 707/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:02.367457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:02.370380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:02.405196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb0e7-58c8-4587-bc52-0f359008fccd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:02.405579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb0e7-58c8-4587-bc52-0f359008fccd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:02.405936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb0e7-58c8-4587-bc52-0f359008fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:02.487720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-27bdb0e7-58c8-4587-bc52-0f359008fccd None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:02.501695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-27bdb0e7-58c8-4587-bc52-0f359008fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:02.657719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:02.830112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dfa2-6f22-41dd-abb3-c21f16320e22 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:02.897673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 708/1420] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Oct 15 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:02.899566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:02.900083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:02.904661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:03.018274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] MFA Rules not processed for user `e2e9bd7bd9384c079e8d4bcfadbf08a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:03.020122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:03.209898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:03.217745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:03.217745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:03.219270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] PATH_INFO: `/v3/users/6a75178408934490be5ed669ec3da6e0` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:03.224382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a75178408934490be5ed669ec3da6e0)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:03.226499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:03.330381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 709/1421] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:03.360284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:03.362120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:03.648802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a75178408934490be5ed669ec3da6e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:03.668617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:03.736590 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a75178408934490be5ed669ec3da6e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:03.738649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a75178408934490be5ed669ec3da6e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:03.740514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a75178408934490be5ed669ec3da6e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:03.748393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fb178-48bc-494a-8d15-da3ef3bcf306 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:03.763494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:03.765362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:03.766295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:03.767004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:03.772768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:03.790480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a75178408934490be5ed669ec3da6e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:03.809055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:03.814102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38e6d6-e57a-4ef2-b724-1cb3e29eb39f service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:03.855117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 710/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:03.881523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 713/1423] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:02 2022] DELETE /identity/v3/users/6a75178408934490be5ed669ec3da6e0 => generated 0 bytes in 1515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:03.890079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:03.890710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:03.891383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:04.068779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:04.071562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:04.077262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:04.079403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:04.399989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d96d7-b5b4-4488-b5d4-cba906b3c0ef admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:04.408464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:04.409679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:04.410130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:04.410569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:04.416328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:04.435484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:04.441145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:04.446276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:04.470511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 714/1424] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:04.536336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 711/1425] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:04.777376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:04.797707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6de68-3568-437b-aea9-9f8a0d2cc64f service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:04.817210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:04.818958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:04.819370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:04.820809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:04.857887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:04.864563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:04.935668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 715/1426] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:05.655266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:05.669119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:05.715763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec2abd-5cff-48cf-8693-8de402699d25 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:05.732869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:05.733592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:05.736156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:05.736483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] PATH_INFO: `/v3/projects/abca6a3653b04060a198e6b0b59962e2` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:05.769470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abca6a3653b04060a198e6b0b59962e2)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:05.805411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:06.149704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abca6a3653b04060a198e6b0b59962e2', 'request_id': 'req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.170295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:06.173245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:06.194815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abca6a3653b04060a198e6b0b59962e2', 'request_id': 'req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.231701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5eb60-d54c-42f9-9a30-372babecb382 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:06.249476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abca6a3653b04060a198e6b0b59962e2', 'request_id': 'req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.304293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] The token cache is being invalidate because project abca6a3653b04060a198e6b0b59962e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:06.304806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.312644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-d0be0b1f-767a-4dc2-b673-bb3ad001deb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.324679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 712/1427] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:05 2022] DELETE /identity/v3/projects/abca6a3653b04060a198e6b0b59962e2 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:06.327282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74162e-395e-46ee-98fc-2a2bd05ba5f3 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:06.327834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74162e-395e-46ee-98fc-2a2bd05ba5f3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:06.338442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74162e-395e-46ee-98fc-2a2bd05ba5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:06.473796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:06.474496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:06.474858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:06.475156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] PATH_INFO: `/v3/users/d945c7888c52453abd1307f89a450a65` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:06.492752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d945c7888c52453abd1307f89a450a65)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:06.497028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:06.503420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0c74162e-395e-46ee-98fc-2a2bd05ba5f3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:06.505734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0c74162e-395e-46ee-98fc-2a2bd05ba5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:06.548548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 713/1428] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:06.548548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f8c3-7982-4537-9eef-beeebfe91a80 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:06.548548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f8c3-7982-4537-9eef-beeebfe91a80 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:06.548548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f8c3-7982-4537-9eef-beeebfe91a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:06.583538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3362f8c3-7982-4537-9eef-beeebfe91a80 None None] MFA Rules not processed for user `e35bc05d950647809337ef28ab710e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:06.606508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3362f8c3-7982-4537-9eef-beeebfe91a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:06.692390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd945c7888c52453abd1307f89a450a65'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.770385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd945c7888c52453abd1307f89a450a65'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.778349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd945c7888c52453abd1307f89a450a65'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.796809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd945c7888c52453abd1307f89a450a65'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.801496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:06.823880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-11ae17a8-49f6-4922-91b4-5ca4b84dc024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd945c7888c52453abd1307f89a450a65'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:06.928758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 716/1429] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:06 2022] DELETE /identity/v3/users/d945c7888c52453abd1307f89a450a65 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:06.928758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:06.928758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:06.928758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:07.004307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:07.007561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:07.146124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 714/1430] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 620 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:07.150196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:07.150995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:07.151618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:07.246249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:07.257658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:07.486510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 717/1431] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:07.496171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:07.546139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed713e-5c16-48db-9540-1354fae1f1e3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:07.566841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 715/1432] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:07.569084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:07.569747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:07.570031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:07.570294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:07.570988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:07.571362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:07.580080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:07.585955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:07.588184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:07.660125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:07.664843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 718/1433] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:07.665868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:07.748974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8cd6-db59-4e69-b134-54439dbb0aff admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:07.782035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:07.801978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:07.801978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:07.801978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:07.801978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:07.801978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652f781-17b6-4f9b-90d4-5e1aee40997a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:07.860904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 719/1434] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:07 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:07.865293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:07.866578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:07.869207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:07.967485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f4982-8f57-4bb1-b80b-89039ca986dc None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:07.979132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] MFA Rules not processed for user `4fa389333d2a4ffe938dd78229d78ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:07.982364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:08.241394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 720/1435] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:08.245035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:08.280598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:08.282178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:08.285481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:08.286431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:08.431275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:08.495962 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:08.497638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f58e3d-e471-413e-9ad9-931a0e68aa58 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:08.526143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 716/1436] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 941 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:08.527594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:08.527911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:08.528186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:08.560838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] MFA Rules not processed for user `4fa389333d2a4ffe938dd78229d78ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:08.562202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:08.575933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 717/1437] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:08.577011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:08.578516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:08.594837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa015e8b-6bee-4686-857f-8d3c6cab6430 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:08.601694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:08.602378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:08.602675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:08.602924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] PATH_INFO: `/v3/users/7365db7a76a24e13a33d199c4b7d0e27` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:08.604315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7365db7a76a24e13a33d199c4b7d0e27)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:08.606587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:08.669627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e48bc1-1448-4ccd-a85e-fd4f8d3f5442 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:08.684992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7365db7a76a24e13a33d199c4b7d0e27'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:08.704279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7365db7a76a24e13a33d199c4b7d0e27'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:08.706779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7365db7a76a24e13a33d199c4b7d0e27'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:08.708354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7365db7a76a24e13a33d199c4b7d0e27'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:08.713856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:08.723662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:08.725745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:08.728505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:08.729416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-72446259-8535-44de-aedf-dc11ab205182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7365db7a76a24e13a33d199c4b7d0e27'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:08.730025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:08.734438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:08.738764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:08.759464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 718/1438] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:08 2022] DELETE /identity/v3/users/7365db7a76a24e13a33d199c4b7d0e27 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:08.768135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:08.768974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:08.769475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:08.860404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:08.865822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:08.876200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 721/1439] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:08 2022] POST /identity/v3/users => generated 292 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:08.878767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:08.910355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:08.981730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aa651-5623-46d2-80f8-2e3a3e1d2721 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:09.201792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 719/1440] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:09.309768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:09.314885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:09.324348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:09.325426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:09.326057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:09.326444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:09.327605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:09.330678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:09.375746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 722/1441] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:09.380400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:09.420027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860c54-052f-47df-9a5e-3d008b2c0c39 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:09.439456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:09.440493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:09.443654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:09.444221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:09.445438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:09.459184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:09.507390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 723/1442] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:49:09.512305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:09.553762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626621-b2b3-4fdc-a33d-25de18b71c2c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:09.579054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:09.580175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:09.580656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:09.582416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] PATH_INFO: `/v3/projects/15cd04848b2149be883c48b60395eac5/users/d382ba0bbc37458681c3454d79b077dc/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:09.626676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8badb0e-f160-46a3-bca1-a9c26cdd6f11 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:09.643123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:09.643819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:09.644373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:09.644679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:09.656555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cd04848b2149be883c48b60395eac5, user_id=d382ba0bbc37458681c3454d79b077dc, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:09.662352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30a337-3192-41cf-b14e-23df93872f95 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:09.697633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:09.723845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614b4d-0bc2-4230-b6f6-b4f882136b26 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:09.730028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 724/1443] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:09 2022] PUT /identity/v3/projects/15cd04848b2149be883c48b60395eac5/users/d382ba0bbc37458681c3454d79b077dc/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:09.744101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:09.744431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:09.744860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:09.828324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 720/1444] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:09.915813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] MFA Rules not processed for user `d382ba0bbc37458681c3454d79b077dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:09.921503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:10.150974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ad7b-303e-4529-b7fb-690680859193 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:10.153802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ad7b-303e-4529-b7fb-690680859193 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:10.154852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ad7b-303e-4529-b7fb-690680859193 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:10.161767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 721/1445] 10.222.0.33 () {54 vars in 912 bytes} [Sat Oct 15 13:49:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:49:10.173860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:10.174719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:10.175373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:10.367811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:10.377524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:10.418819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 725/1446] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 675 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:10.420638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:10.431418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:10.509153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:10.684645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 722/1447] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:10.688189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:10.894014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:10.916162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940664f-efd8-4692-a20d-16b96cb46244 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:10.950613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:10.951752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:10.952310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:10.952783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:10.965934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:11.033967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5be86-1f02-431e-9e59-1aabc4c5bf53 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:11.074980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:11.076569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:11.079442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:11.082199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:11.083547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:11.101360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:11.248076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 723/1448] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:10 2022] POST /identity/v3/projects => generated 381 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:11.249708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:11.317533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:11.332187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:11.378429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 726/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 959 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:11.381929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:11.397406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:11.467625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8217-86c6-4097-9cf6-d8f7acf74d51 service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:11.732692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:11.732692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:11.732692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:11.732692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] PATH_INFO: `/v3/projects/682e10da37b946b7a7d4befd72a4189b` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:11.738543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=682e10da37b946b7a7d4befd72a4189b)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:11.748655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:11.903151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ac2a-7c88-4422-aa90-41b371a9cfe4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:11.921080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:11.922033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:11.922455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:11.922899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:11.949317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:11.962259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:11.983124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:11.987665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682e10da37b946b7a7d4befd72a4189b', 'request_id': 'req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:11.989643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 724/1450] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:11.990705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:12.015242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682e10da37b946b7a7d4befd72a4189b', 'request_id': 'req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.044958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682e10da37b946b7a7d4befd72a4189b', 'request_id': 'req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.047054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2d55d-f6a2-4917-ac27-39d15cb19320 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:12.089881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] The token cache is being invalidate because project 682e10da37b946b7a7d4befd72a4189b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:12.089990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.091592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.101939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 727/1451] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:11 2022] DELETE /identity/v3/projects/682e10da37b946b7a7d4befd72a4189b => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:12.103308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:12.111201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:12.237459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:12.240252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:12.240597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:12.240928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:12.244727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:12.249647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:12.340242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 725/1452] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:11 2022] POST /identity/v3/users => generated 297 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:12.341941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:12.345834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763849-61d8-4fa0-89fc-a45bf38d5bdb admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:12.349719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:12.370462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:12.371235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:12.371477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:12.371757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] PATH_INFO: `/v3/projects/4a87bafe6d964d298987ac892f075e92` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:12.382684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a87bafe6d964d298987ac892f075e92)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:12.384867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:12.396947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ca7f-4f7b-4c7e-beb7-9d646409b47e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:12.426579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:12.429815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:12.431212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:12.432431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] PATH_INFO: `/v3/users/d028e69e08044026815030db846d60fb` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:12.439025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d028e69e08044026815030db846d60fb)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:12.450688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:12.569830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a87bafe6d964d298987ac892f075e92', 'request_id': 'req-afd22aeb-1608-4ee3-8a96-427f0a6feb45'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.581329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a87bafe6d964d298987ac892f075e92', 'request_id': 'req-afd22aeb-1608-4ee3-8a96-427f0a6feb45'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.611259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a87bafe6d964d298987ac892f075e92', 'request_id': 'req-afd22aeb-1608-4ee3-8a96-427f0a6feb45'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.664390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] The token cache is being invalidate because project 4a87bafe6d964d298987ac892f075e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:12.664849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.666217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.673199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 728/1453] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:12 2022] DELETE /identity/v3/projects/4a87bafe6d964d298987ac892f075e92 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:12.673199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:12.673587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd028e69e08044026815030db846d60fb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.677743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:12.687293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:12.713107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd028e69e08044026815030db846d60fb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.716783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd028e69e08044026815030db846d60fb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.722828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd028e69e08044026815030db846d60fb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.758487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd028e69e08044026815030db846d60fb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:12.833368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 726/1454] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:12 2022] DELETE /identity/v3/users/d028e69e08044026815030db846d60fb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:12.835505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:12.841206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:12.905794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22aeb-1608-4ee3-8a96-427f0a6feb45 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:12.926434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:13.012360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb54d6a-0750-4262-83ab-0fc9e77e178d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:13.023602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:13.024862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:13.025483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:13.036223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] PATH_INFO: `/v3/projects/536899df91d0402b9548341149659a26` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:13.038978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536899df91d0402b9548341149659a26)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:13.045754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:13.062261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:13.064931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:13.066379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:13.066724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:13.069737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:13.075212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:13.110534 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 729/1455] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:13.112893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:13.118159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:13.163928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5863-0325-45ce-82b3-cf00cdb2062e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:13.231467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536899df91d0402b9548341149659a26', 'request_id': 'req-df315dca-cc59-41d0-8619-4522ede34e40'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.253522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536899df91d0402b9548341149659a26', 'request_id': 'req-df315dca-cc59-41d0-8619-4522ede34e40'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.272675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536899df91d0402b9548341149659a26', 'request_id': 'req-df315dca-cc59-41d0-8619-4522ede34e40'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.321379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] The token cache is being invalidate because project 536899df91d0402b9548341149659a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:13.321835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.324324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.332588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 727/1456] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:12 2022] DELETE /identity/v3/projects/536899df91d0402b9548341149659a26 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:13.338687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:13.348274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:13.374540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:13.376506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:13.377470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:13.378259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] PATH_INFO: `/v3/users/63d11d3fcdef4c79939eb3950e31872f` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:13.385368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d11d3fcdef4c79939eb3950e31872f)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:13.390448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:13.400066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315dca-cc59-41d0-8619-4522ede34e40 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:13.421986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:13.425528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:13.426432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:13.429755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] PATH_INFO: `/v3/projects/c017be4f682c409580cc6d1c9c0445ae/users/80c86a8f423d41f69b798a1c72e61a8f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:13.494269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c017be4f682c409580cc6d1c9c0445ae, user_id=80c86a8f423d41f69b798a1c72e61a8f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:13.509631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae5d79-0435-46a5-9619-5c22e6e06539 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:13.546109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 728/1457] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:13 2022] PUT /identity/v3/projects/c017be4f682c409580cc6d1c9c0445ae/users/80c86a8f423d41f69b798a1c72e61a8f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:13.572610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c68d-06d8-47f3-b608-0d7f713430b4 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:13.572942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c68d-06d8-47f3-b608-0d7f713430b4 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:13.573360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c68d-06d8-47f3-b608-0d7f713430b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:13.590978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d11d3fcdef4c79939eb3950e31872f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.636817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d11d3fcdef4c79939eb3950e31872f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.641535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d11d3fcdef4c79939eb3950e31872f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.644127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d11d3fcdef4c79939eb3950e31872f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.678511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d11d3fcdef4c79939eb3950e31872f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:13.707336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-32d6c68d-06d8-47f3-b608-0d7f713430b4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:13.717588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-32d6c68d-06d8-47f3-b608-0d7f713430b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:13.798845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 730/1458] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:13 2022] DELETE /identity/v3/users/63d11d3fcdef4c79939eb3950e31872f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:13.808037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:13.818286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:13.886860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:14.022793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:14.084350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 729/1459] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:14.093221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.094008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.094559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.194706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:14.197400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394c04-4bd6-4151-8f84-d375ad19dbbf admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:14.199938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:14.206688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:14.207656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.209456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.209934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.211290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:14.214266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:14.232697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 730/1460] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:14.238784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 731/1461] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:14.239520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:14.240322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:14.272376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9b94-e050-4e52-b52d-adf320890d61 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:14.278017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af34ea-1412-405e-b458-ca18888100c8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:14.282921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:14.285201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.285988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.286695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.288085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:14.288899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:14.292602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a083-0a92-4ae8-93fd-f7743ad17104 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:14.301652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:14.302557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.302849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.303166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] PATH_INFO: `/v3/projects/c017be4f682c409580cc6d1c9c0445ae/users/80c86a8f423d41f69b798a1c72e61a8f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.309812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c017be4f682c409580cc6d1c9c0445ae, user_id=80c86a8f423d41f69b798a1c72e61a8f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:14.315090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:14.365234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 732/1462] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:14 2022] PUT /identity/v3/projects/c017be4f682c409580cc6d1c9c0445ae/users/80c86a8f423d41f69b798a1c72e61a8f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:14.366093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 731/1463] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:49:14.371164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:14.389282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4ee0-1448-4f77-a89d-8041ca6a1421 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.389941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4ee0-1448-4f77-a89d-8041ca6a1421 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.390355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4ee0-1448-4f77-a89d-8041ca6a1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.489021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-04ed4ee0-1448-4f77-a89d-8041ca6a1421 None None] MFA Rules not processed for user `80c86a8f423d41f69b798a1c72e61a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:14.491954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-04ed4ee0-1448-4f77-a89d-8041ca6a1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:14.587281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19561-bad7-4545-aa1f-4610d028f6cc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:14.601952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:14.602817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.603195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.603469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.604180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:14.607381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:14.692887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 733/1464] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:14 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:14.698827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:14.848624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 732/1465] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:14.851545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:14.852473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:14.852978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:14.856592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 733/1466] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:49:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:49:14.862025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:14.866082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:15.014510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6499c-3827-4755-9b15-24ca4f5465ee admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.025508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.026926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.027554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.028200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.029576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.036092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d54086-5f27-4a35-be7e-b14b798bf7e8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.090737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b21c-63ff-4d32-b039-8385ea0ad70f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.102323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.104987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.108197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.109938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.122096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 734/1467] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:14 2022] POST /identity/v3/users => generated 290 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:15.122096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.122096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.122096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.193935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:15.195733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:15.256347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:15.297256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.299517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.304576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:15.363062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 734/1468] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:15.363731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:15.423675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc54cc-8935-4660-acd2-1465b6055dd5 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.438980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.441941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.442280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.442525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.443274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.445029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.487658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 735/1469] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:15.488957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:15.510669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 735/1470] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:15.523687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d861-92fb-4b23-ab67-31fae037288e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.531192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.532281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.533699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.534243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.535291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.537520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.564454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 736/1471] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:15.569020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:15.585538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35443-5281-40b4-9062-e32c5d6c6953 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.610479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.611258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.611585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.611882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] PATH_INFO: `/v3/projects/4f77151ea6864bf0963ced7213e45030/users/53a711055e0f4913a6a003c18a62b000/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.615058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:15.630354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e91a-75b2-4764-a63f-d3025bd0dc5f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:15.649816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:15.650475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.651109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.651109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.655592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:15.666494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f77151ea6864bf0963ced7213e45030, user_id=53a711055e0f4913a6a003c18a62b000, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.673404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5569e-e0c0-4b33-aeed-28e762188083 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.713201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 736/1472] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:15 2022] PUT /identity/v3/projects/4f77151ea6864bf0963ced7213e45030/users/53a711055e0f4913a6a003c18a62b000/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:15.725893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:15.725893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:15.726237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:15.815181 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] MFA Rules not processed for user `53a711055e0f4913a6a003c18a62b000`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:15.815774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:15.842376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:15.846743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:15.873319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 737/1473] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:16.288655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:16.298952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:16.379080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea18ad9-09fc-440f-9d08-de23899676f8 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:16.772105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 737/1474] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 1048 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:16.783348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:16.796948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:16.802640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:16.804676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:16.805058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:16.845138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:16.851183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:16.903359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 738/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:17.177228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2ab55-36c8-4550-af9e-a55a34e7c02b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:17.222986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:17.226155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:17.241711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:17.246034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:17.246502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:17.246951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:17.248140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:17.275609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:17.378815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de31eb-0512-4bf6-a3d9-75d6cc015218 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:17.437900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:17.438986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:17.445950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:17.457326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] PATH_INFO: `/v3/projects/cf0ee10325eb4776817f16bf312d5731` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:17.466763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0ee10325eb4776817f16bf312d5731)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:17.498413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:17.571920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 738/1476] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:16 2022] POST /identity/v3/projects => generated 381 bytes in 796 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:17.581644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:17.624573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:17.854074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:17.877365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0ee10325eb4776817f16bf312d5731', 'request_id': 'req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:17.925275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0ee10325eb4776817f16bf312d5731', 'request_id': 'req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:17.955630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0ee10325eb4776817f16bf312d5731', 'request_id': 'req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:17.970700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b204-03f3-47d9-a2f8-71c58c099b8b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:18.004168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] The token cache is being invalidate because project cf0ee10325eb4776817f16bf312d5731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:18.004844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:18.006184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-769d6fd9-178a-42b9-a42f-0ddaa5e249a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:18.015562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 739/1477] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:17 2022] DELETE /identity/v3/projects/cf0ee10325eb4776817f16bf312d5731 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:18.019843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c856-32f2-40a0-bae8-d71388c3bacd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.026381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c856-32f2-40a0-bae8-d71388c3bacd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.028761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c856-32f2-40a0-bae8-d71388c3bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.171586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9213c856-32f2-40a0-bae8-d71388c3bacd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:18.185584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9213c856-32f2-40a0-bae8-d71388c3bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:18.206578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:18.208354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.208957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.209741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.210989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:18.216468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:18.287484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 739/1478] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:17 2022] POST /identity/v3/users => generated 297 bytes in 707 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:18.291654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:18.294438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:18.314566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0b120-f42c-4f86-bcf2-ab130f596370 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:18.320817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:18.331692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.333056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.333797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.335296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:18.338050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:18.358801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 740/1479] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:18.365378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:18.394141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7234963-1b77-4c90-9547-68c242d3dc2c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:18.414441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:18.415152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.415674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.415979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] PATH_INFO: `/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a/users/d7b7b86125ba40a99069d15c82176be2/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.480561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 740/1480] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:18.482406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.482732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.482977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.495202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2104f5d5363b4c0d9179f1a61cd69a4a, user_id=d7b7b86125ba40a99069d15c82176be2, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:18.510404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:18.523262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:18.524831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:18.560170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 741/1481] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:18.562809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:18.575775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 741/1482] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:18 2022] PUT /identity/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a/users/d7b7b86125ba40a99069d15c82176be2/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:18.580452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:18.584178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad158-0881-4ab7-a62e-af07391516ef None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:18.848007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe9a46-c5ad-49cf-9bab-098b55eb0bc3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:18.857720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:18.858483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.858776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.859057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.859757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:18.888658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:18.975761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 742/1483] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:18.976507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:18.985863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:18.991519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:18.992095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:18.992380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:18.992654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:18.993345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:18.993653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:19.002901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:19.034391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7e9c5-fc74-4f95-ac02-131ffa524fb5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:19.054685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 742/1484] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:19.055747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:19.067278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:19.068193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.069732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.070007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] PATH_INFO: `/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.073418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020045ef-b183-4711-8b79-2209a1db827d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:19.077527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da2cea8bf0b4bcfa012cb0f9ca37fc4)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:19.079039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:19.079820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.080110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.080388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] PATH_INFO: `/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a/users/d7b7b86125ba40a99069d15c82176be2/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.082547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2104f5d5363b4c0d9179f1a61cd69a4a, user_id=d7b7b86125ba40a99069d15c82176be2, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:19.085589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:19.091301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:19.095567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:19.133061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 743/1485] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:19 2022] PUT /identity/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a/users/d7b7b86125ba40a99069d15c82176be2/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:19.134012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:19.271458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:19.314164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da2cea8bf0b4bcfa012cb0f9ca37fc4', 'request_id': 'req-66bd4761-c4cb-45fa-938e-6a8e185d887e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:19.326169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb63-b0e8-46ac-acfe-a5a4018ffb36 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:19.357579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da2cea8bf0b4bcfa012cb0f9ca37fc4', 'request_id': 'req-66bd4761-c4cb-45fa-938e-6a8e185d887e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:19.415826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da2cea8bf0b4bcfa012cb0f9ca37fc4', 'request_id': 'req-66bd4761-c4cb-45fa-938e-6a8e185d887e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:19.465459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] The token cache is being invalidate because project 5da2cea8bf0b4bcfa012cb0f9ca37fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:19.465712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:19.472478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-66bd4761-c4cb-45fa-938e-6a8e185d887e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:19.492268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 743/1486] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:18 2022] DELETE /identity/v3/projects/5da2cea8bf0b4bcfa012cb0f9ca37fc4 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:19.492268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30788-77c6-4a7e-b4af-600d0b467593 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.492268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30788-77c6-4a7e-b4af-600d0b467593 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.492268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30788-77c6-4a7e-b4af-600d0b467593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.556646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:19.557376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.557698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.558404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.558703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:19.564472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa17489-5ea8-4b0c-870e-7765c32a5221 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:19.601172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7cb30788-77c6-4a7e-b4af-600d0b467593 None None] MFA Rules not processed for user `d7b7b86125ba40a99069d15c82176be2`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:19.602478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7cb30788-77c6-4a7e-b4af-600d0b467593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:19.682854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 744/1487] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:19 2022] POST /identity/v3/projects => generated 387 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:19.684433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.684720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.685001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.769677 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:19.773999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:19.787277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 744/1488] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:19.792363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:19.792722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:19.793179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:19.857597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] MFA Rules not processed for user `e2e9bd7bd9384c079e8d4bcfadbf08a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:19.863153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:19.984731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 745/1489] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:19.984731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:19.984731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:20.015100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660cb4-ef90-45db-bbd3-bb60eaacea6a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.025946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 745/1490] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:20.027914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.030784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:20.038236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.039010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.039362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.039719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.040937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.043276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e8e3f-1c47-409f-b71e-f7a38e6d989e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.125201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:20.143548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 746/1491] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:19 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:20.149545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.155529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.156054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.238740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:20.242885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:20.265279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb1a0-53c0-4bdc-bbe1-1bb636ffbfe5 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.274971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.275653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.275968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.276393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.292486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 747/1492] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:20.300113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.327431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000442-1080-4d2e-ad46-7cca976a4df7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.337684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.338791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.339286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.340082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.341269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.345406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.370124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 748/1493] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:20.372767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.400103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bbed0-6823-48ff-b26b-457f4203ec27 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.412836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.414508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.415979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.416708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.419270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:20.420073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.424499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.460211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 749/1494] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:20.461973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.495909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a0779-454a-4bed-aef7-68284f926634 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.517911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.518768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.519269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.519582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.520298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.522034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.524703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.526323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.556293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 750/1495] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:20.556293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.566393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 746/1496] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:20.567916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.570130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:20.575070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d89d-c070-47f9-adb8-d13040ff42a0 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.604874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.606008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.606506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.607012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.608615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.621779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1714-385b-4253-8a4e-4a06c1fce14a service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:20.638426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:20.639129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:20.639408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:20.639684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] PATH_INFO: `/v3/users/d382ba0bbc37458681c3454d79b077dc` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:20.641261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d382ba0bbc37458681c3454d79b077dc)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:20.644313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.653258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:20.774027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:20.806660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 751/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:20 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:20.808268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:20.879623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd382ba0bbc37458681c3454d79b077dc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:20.912635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd382ba0bbc37458681c3454d79b077dc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:20.913934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd382ba0bbc37458681c3454d79b077dc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:20.914985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd382ba0bbc37458681c3454d79b077dc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:20.936640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd382ba0bbc37458681c3454d79b077dc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:21.013273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b030-1069-4b70-b955-b8dcf07872c8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:21.015735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 747/1498] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:20 2022] DELETE /identity/v3/users/d382ba0bbc37458681c3454d79b077dc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:21.017919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:21.021236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.241675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:21.292521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea0fe-7c04-4110-a045-96ca08766cf6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:21.299169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:21.300463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.303982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.304562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] PATH_INFO: `/v3/projects/88bd9fbec8c2431ba91b3113c8100adb/users/ededc696ce0d4e33bc434ca6d6dd3d94/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.304959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:21.306293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.307129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.308669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.314961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.380410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bd9fbec8c2431ba91b3113c8100adb, user_id=ededc696ce0d4e33bc434ca6d6dd3d94, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:21.404878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:21.465280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 752/1499] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:20 2022] PUT /identity/v3/projects/88bd9fbec8c2431ba91b3113c8100adb/users/ededc696ce0d4e33bc434ca6d6dd3d94/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:21.466352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:21.484158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.615250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:21.616862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a87f-4f8a-4ced-a81e-edd7fd5f2b69 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:21.656395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 748/1500] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:21.658805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f48b-2ff8-439f-b0fa-32082afafff3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.659220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f48b-2ff8-439f-b0fa-32082afafff3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.659487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f48b-2ff8-439f-b0fa-32082afafff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.710560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78173010-8f2b-4121-ba6c-21e87b701555 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:21.726977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:21.733412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.733941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.734592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.735721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:21.738560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:21.740526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6ac5f48b-2ff8-439f-b0fa-32082afafff3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:21.742791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6ac5f48b-2ff8-439f-b0fa-32082afafff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.766060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 749/1501] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:21.768522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.769005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.769671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.794242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 753/1502] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:21 2022] POST /identity/v3/users => generated 295 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:21.805243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:21.863528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46e045-ba96-4515-8cca-83a6c1cc2f47 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:21.865875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] MFA Rules not processed for user `ededc696ce0d4e33bc434ca6d6dd3d94`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:21.880093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.884843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:21.886918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:21.888348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:21.889630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:21.893570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:21.899930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:21.935306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 754/1503] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:21.936499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:21.938667 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:21.966590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:22.164407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 750/1504] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:22.165251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.191835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0cfe-2285-4579-bbb0-caf9ba5ed760 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.207894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.209111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.210860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.211306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.214817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7cfb4-db12-49f9-9159-689401dd5d83 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.230420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.231936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.231936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.232775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.236515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.238955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.242354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.244085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.271247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 755/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:22.275715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 751/1506] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:22.278026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.278547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.281271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:22.302315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4266-8480-44e6-a243-34562055d38f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.310337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6a1cc-7e9f-4c42-aab3-7eb6e136e0c1 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.315414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.316314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.316762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.317188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] PATH_INFO: `/v3/projects/67f8e5c8d12f485485ea5a5cc6427b16/users/79b279e3124b472dae465b57d849bcef/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.324326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.325292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.328658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.329140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.330046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.332239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.355659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f8e5c8d12f485485ea5a5cc6427b16, user_id=79b279e3124b472dae465b57d849bcef, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.358894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf91581-42a6-4a1f-a69c-4b245596e70c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.393930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 752/1507] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:22 2022] PUT /identity/v3/projects/67f8e5c8d12f485485ea5a5cc6427b16/users/79b279e3124b472dae465b57d849bcef/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:22.414122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.415924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.420577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.420786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 756/1508] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:22 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:22.423429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.540492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] MFA Rules not processed for user `79b279e3124b472dae465b57d849bcef`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:22.543694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:22.689147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629222f-e202-4e5a-955a-652776455e0e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.690404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:22.706170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.708049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.708504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.708965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.710591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.727935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.760482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 753/1509] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:22.769471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.794492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 757/1510] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:22 2022] POST /identity/v3/users => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:22.799274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.802890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3b55b-c293-42bc-b75c-f10aafcce7d5 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.811182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.812221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.812640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.813117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.814539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.816887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.849720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c20f-ab5a-4616-9584-f637b7b0897b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:22.874763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:22.875842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:22.876325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:22.876806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:22.878361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:22.881641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:22.887255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 754/1511] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:22 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:22.890895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.927339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 758/1512] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:49:22.937169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:22.951731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465049b-2b92-443d-a55b-226489e2d5db admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.004804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fa063-3bdd-4e01-bd76-4d1ae888bf94 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.011660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.012598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.012955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.013298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.014033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.018219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.056387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.057420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.057856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.058518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] PATH_INFO: `/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62/users/f35ddc9ff6714c5c90c5cb96eb362956/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.069514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 755/1513] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:22 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:23.075466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.082246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:23.094358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb896b4e1c546d689d01f4a8a66ba62, user_id=f35ddc9ff6714c5c90c5cb96eb362956, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.098881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.100742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d809c8e-e14c-442f-a4e1-dda8511b4f29 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.111160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.112323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.112657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.114141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.115420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.117403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.144658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 756/1514] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:23.145959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 759/1515] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:22 2022] PUT /identity/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62/users/f35ddc9ff6714c5c90c5cb96eb362956/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:23.151119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.161379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.178205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd094-9d2e-4df3-a9d6-73ae3157f33b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.338373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455feb-33d6-43d8-9c72-4ff111a3c80a admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.354173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.355771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.356248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.356743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.358311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.361224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.375488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 760/1516] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:23.381258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.392820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.394276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.394871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.395380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] PATH_INFO: `/v3/projects/e75aff4df16d491da112a95f254116f8/users/8a3b578b9aaa4a6896d62760372334d1/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.399982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b64be-a3bb-4aba-9c39-77c6fa96cd06 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.415394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.424094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.425982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.425982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] PATH_INFO: `/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62/users/f35ddc9ff6714c5c90c5cb96eb362956/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.437388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb896b4e1c546d689d01f4a8a66ba62, user_id=f35ddc9ff6714c5c90c5cb96eb362956, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.446761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763cb5-0b77-4444-b319-9c0fb99fd535 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.447423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75aff4df16d491da112a95f254116f8, user_id=8a3b578b9aaa4a6896d62760372334d1, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.454971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.500065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 757/1517] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:23 2022] PUT /identity/v3/projects/e75aff4df16d491da112a95f254116f8/users/8a3b578b9aaa4a6896d62760372334d1/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:23.503557 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.524240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 761/1518] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:23 2022] PUT /identity/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62/users/f35ddc9ff6714c5c90c5cb96eb362956/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:23.542444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:23.548775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.549276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.549750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.650229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18319-b38b-43de-b2c2-04e9a7f7000f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.682635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] MFA Rules not processed for user `f35ddc9ff6714c5c90c5cb96eb362956`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:23.684810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:23.777166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.778011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.778430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.778841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.779780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.788911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:23.877020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 758/1519] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:23.886676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:23.922738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa812-7ea3-48f4-bfbb-0f0ce01e978c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:23.948785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:23.950461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:23.951991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:23.952487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] PATH_INFO: `/v3/projects/e75aff4df16d491da112a95f254116f8/users/8a3b578b9aaa4a6896d62760372334d1/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:23.968775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75aff4df16d491da112a95f254116f8, user_id=8a3b578b9aaa4a6896d62760372334d1, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:23.983762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa4520-caf4-4860-b848-b99e35d6b441 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:24.069781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 759/1520] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:23 2022] PUT /identity/v3/projects/e75aff4df16d491da112a95f254116f8/users/8a3b578b9aaa4a6896d62760372334d1/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:24.084113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:24.085834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:24.086219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:24.096951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 762/1521] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:24.106909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:24.221758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] MFA Rules not processed for user `8a3b578b9aaa4a6896d62760372334d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:24.227867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:24.480429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 760/1522] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:24.527853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a363d6d-579d-48a9-9c5c-b57ce132f51d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:24.576236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:24.636587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:24.638208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:24.687622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:24.834522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:24.835346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:24.835747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:24.836121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:24.865740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67233d4-979a-4771-9556-43a222f75b58 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:24.896102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:24.896974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:24.898722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:24.898722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:24.956413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:24.961472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:24.998443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 761/1523] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:25.033079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:25.039419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:25.090407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 763/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 983 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:25.168458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:25.189004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9f0e-b713-4596-a529-68145d00fafa service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:25.202101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:25.206175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:25.206175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:25.206175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:25.487805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:25.518255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:25.525434 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f057ed-8167-4910-8a2d-9fbbbc13a490 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:25.578924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 762/1525] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:25.625781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121da0-8638-49ca-8e1e-0d064f60da1d None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:25.626084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121da0-8638-49ca-8e1e-0d064f60da1d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:25.626659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121da0-8638-49ca-8e1e-0d064f60da1d None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:25.628662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 763/1526] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:49:25.667912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:25.668293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:25.668488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:25.758618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:25.763859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:25.825336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a728-3807-4cc4-a666-110815dc7349 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:25.837489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:25.839684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:25.840477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:25.841167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] PATH_INFO: `/v3/users/ededc696ce0d4e33bc434ca6d6dd3d94` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:25.859571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ededc696ce0d4e33bc434ca6d6dd3d94)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:25.866503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:26.110639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ededc696ce0d4e33bc434ca6d6dd3d94'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.160514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ededc696ce0d4e33bc434ca6d6dd3d94'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.161720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ededc696ce0d4e33bc434ca6d6dd3d94'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.164177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ededc696ce0d4e33bc434ca6d6dd3d94'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.175304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 764/1527] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:26.177254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:26.184562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:26.192037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-05b6378b-5953-403e-9f55-b0cf3b28e436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ededc696ce0d4e33bc434ca6d6dd3d94'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.195494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:26.257858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ec61-cdcf-4412-ad89-9eab680fe9d6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:26.258537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 764/1528] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:25 2022] DELETE /identity/v3/users/ededc696ce0d4e33bc434ca6d6dd3d94 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:26.261220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8350a-100c-435d-ab67-d6ac75304750 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:26.261998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8350a-100c-435d-ab67-d6ac75304750 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:26.262475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8350a-100c-435d-ab67-d6ac75304750 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:26.265377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 765/1529] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:49:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:49:26.268372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408256fb-7d1b-4387-9b87-dbf437f7551d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:26.270130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408256fb-7d1b-4387-9b87-dbf437f7551d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:26.271028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408256fb-7d1b-4387-9b87-dbf437f7551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:26.333392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-408256fb-7d1b-4387-9b87-dbf437f7551d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:26.341793 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-408256fb-7d1b-4387-9b87-dbf437f7551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:26.502591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:26.503324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:26.503606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:26.503939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] PATH_INFO: `/v3/projects/15cd04848b2149be883c48b60395eac5` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:26.506233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cd04848b2149be883c48b60395eac5)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:26.511240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:26.528051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:26.567049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 766/1530] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:26.570531 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:26.570961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:26.571710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:26.670436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:26.690766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:26.701869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cd04848b2149be883c48b60395eac5', 'request_id': 'req-84405ac5-2b00-4bd5-98c4-7b9417f7d999'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.724886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cd04848b2149be883c48b60395eac5', 'request_id': 'req-84405ac5-2b00-4bd5-98c4-7b9417f7d999'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.748649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cd04848b2149be883c48b60395eac5', 'request_id': 'req-84405ac5-2b00-4bd5-98c4-7b9417f7d999'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.788727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] The token cache is being invalidate because project 15cd04848b2149be883c48b60395eac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:26.789232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.792408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:26.801472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 765/1531] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:26 2022] DELETE /identity/v3/projects/15cd04848b2149be883c48b60395eac5 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:26.801472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:26.813785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:26.904079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 767/1532] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:26.904872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:26.912814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:27.022182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405ac5-2b00-4bd5-98c4-7b9417f7d999 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:27.037159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:27.037791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:27.038184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:27.038723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:27.045071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:27.154067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:27.155905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:27.174660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 766/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:27.177179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:27.180260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:27.180483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad9b4-a69b-48ed-9d7a-0660ef73ae79 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:27.196331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:27.198230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:27.199094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:27.199445 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] PATH_INFO: `/v3/users/80c86a8f423d41f69b798a1c72e61a8f` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:27.201496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c86a8f423d41f69b798a1c72e61a8f)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:27.206880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:27.221455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c5eb8-beb4-4a0f-9de1-8e33bb531f5c service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:27.237342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:27.239354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:27.241674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:27.244725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:27.245001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:27.247535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:27.262804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:27.264412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:27.279680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 767/1534] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:27.382467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c86a8f423d41f69b798a1c72e61a8f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:27.411679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c86a8f423d41f69b798a1c72e61a8f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:27.415549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c86a8f423d41f69b798a1c72e61a8f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:27.417804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c86a8f423d41f69b798a1c72e61a8f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:27.432899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:27.442336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c86a8f423d41f69b798a1c72e61a8f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:27.458958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227585c-6df1-4b9f-be2f-9737bece93d5 service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:27.490990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:27.491569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:27.491914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:27.492192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:27.494122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 768/1535] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:26 2022] DELETE /identity/v3/users/80c86a8f423d41f69b798a1c72e61a8f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:27.500052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:27.518298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:27.520233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:27.550662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 768/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:29.070233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:29.076520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:29.280585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bf6d-5390-4a53-acd0-670d3d7b15c4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:29.291307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:29.292263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:29.294727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:29.294727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] PATH_INFO: `/v3/projects/88bd9fbec8c2431ba91b3113c8100adb` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:29.298581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bd9fbec8c2431ba91b3113c8100adb)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:29.300698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:29.440064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bd9fbec8c2431ba91b3113c8100adb', 'request_id': 'req-7bbbabb7-85b3-4612-9457-c03155c5299d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:29.461563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bd9fbec8c2431ba91b3113c8100adb', 'request_id': 'req-7bbbabb7-85b3-4612-9457-c03155c5299d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:29.480561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bd9fbec8c2431ba91b3113c8100adb', 'request_id': 'req-7bbbabb7-85b3-4612-9457-c03155c5299d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:29.523937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] The token cache is being invalidate because project 88bd9fbec8c2431ba91b3113c8100adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:29.524190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:29.524862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:29.527377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 769/1537] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:29 2022] DELETE /identity/v3/projects/88bd9fbec8c2431ba91b3113c8100adb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:29.538285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:29.584702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093770-af86-4069-82c4-5ed96b958c89 service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:29.687964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:29.809299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:29.813851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:29.890044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:29.890389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:29.892139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:29.893595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:29.894266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] PATH_INFO: `/v3/users/f35ddc9ff6714c5c90c5cb96eb362956` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:29.898164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35ddc9ff6714c5c90c5cb96eb362956)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:29.906349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:30.068760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbabb7-85b3-4612-9457-c03155c5299d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:30.121023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:30.125048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:30.126815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:30.128086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] PATH_INFO: `/v3/projects/c017be4f682c409580cc6d1c9c0445ae` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:30.131660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c017be4f682c409580cc6d1c9c0445ae)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:30.138677 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:30.228812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35ddc9ff6714c5c90c5cb96eb362956'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.258716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35ddc9ff6714c5c90c5cb96eb362956'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.260439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35ddc9ff6714c5c90c5cb96eb362956'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.262715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35ddc9ff6714c5c90c5cb96eb362956'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.280650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-86bd57a8-04f9-49a9-8ba2-0e6914245db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35ddc9ff6714c5c90c5cb96eb362956'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.329781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 769/1538] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:29 2022] DELETE /identity/v3/users/f35ddc9ff6714c5c90c5cb96eb362956 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:30.337426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c017be4f682c409580cc6d1c9c0445ae', 'request_id': 'req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.353565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c017be4f682c409580cc6d1c9c0445ae', 'request_id': 'req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.366741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c017be4f682c409580cc6d1c9c0445ae', 'request_id': 'req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.391415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] The token cache is being invalidate because project c017be4f682c409580cc6d1c9c0445ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:30.391828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.392889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9eb7c0a1-2d9b-4651-bfcb-4cee8c4a64a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:30.398655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 770/1539] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:29 2022] DELETE /identity/v3/projects/c017be4f682c409580cc6d1c9c0445ae => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:30.406779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:30.407609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:30.408211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:30.444754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:30.448775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:30.594093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 770/1540] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:30.597417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783828f-46e4-468a-94f4-10635d04112c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:30.597975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783828f-46e4-468a-94f4-10635d04112c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:30.601086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783828f-46e4-468a-94f4-10635d04112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:30.681604 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e783828f-46e4-468a-94f4-10635d04112c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:30.683518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e783828f-46e4-468a-94f4-10635d04112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:30.699415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 771/1541] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:30.702066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:30.737289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c530-3882-4239-be47-c55a3de658fa None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:30.753055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:30.755055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:30.756175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:30.756861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:30.758699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:30.759344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:30.766384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:30.798984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 771/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:30.803955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783828f-46e4-468a-94f4-10635d04112c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:30.822431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783828f-46e4-468a-94f4-10635d04112c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:30.832508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:30.833033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:30.833315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:30.833581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:30.834234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:30.836320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:30.883666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 772/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:30 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:30.885123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:30.923828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fef997-6750-420e-ac38-d3e2502503d4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:30.983288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:31.180851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.180851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.180851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.180851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.183122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.189039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.240996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 772/1544] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:30 2022] POST /identity/v3/users => generated 289 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:31.247817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.271540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c54c4c-b647-4216-8131-bc96dbef36ef admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.283684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.284375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.284654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.284926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.285599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.287279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.314130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 773/1545] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:31.319524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.342379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784d3b-bec8-4172-9dc2-e4b63fb80a37 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.351000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.351890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.352308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.352742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.353614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.356014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f8295-cd9e-44cc-8edb-066202c835a9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.388783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.389877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 773/1546] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:31.407727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb4b0-105b-4261-8df2-413304546126 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.424038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.424754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.425203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.425640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] PATH_INFO: `/v3/projects/f544985d78a9482cbccef12ee5816533/users/80e1c48c337047888bde35b710a4e149/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.462045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f544985d78a9482cbccef12ee5816533, user_id=80e1c48c337047888bde35b710a4e149, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.466269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.496894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 774/1547] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:31 2022] PUT /identity/v3/projects/f544985d78a9482cbccef12ee5816533/users/80e1c48c337047888bde35b710a4e149/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:31.508260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.508834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.508834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.517004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.520260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:31.560832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] MFA Rules not processed for user `80e1c48c337047888bde35b710a4e149`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:31.562116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:31.648263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:31.657918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 774/1548] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:31.662935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.665451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2005-2c93-4634-8680-19a87ee3e0b6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.683562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.684376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.684775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.685199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] PATH_INFO: `/v3/users/53a711055e0f4913a6a003c18a62b000` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.686766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a711055e0f4913a6a003c18a62b000)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.688996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.699644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173abe05-4846-4280-baac-a5ba6b3a84cf None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.707278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:31.712275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.712675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.713022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.714546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:31.717598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:31.769471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 775/1549] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:31 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:31.770996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:31.825616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a711055e0f4913a6a003c18a62b000'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:31.849528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a711055e0f4913a6a003c18a62b000'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:31.850881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a711055e0f4913a6a003c18a62b000'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:31.852163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a711055e0f4913a6a003c18a62b000'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:31.874807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b7ede4fc-1675-4af9-9d83-5c5337496198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a711055e0f4913a6a003c18a62b000'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:31.927888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 775/1550] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:31 2022] DELETE /identity/v3/users/53a711055e0f4913a6a003c18a62b000 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:31.928511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c85f-3eaa-4c6a-a2bf-d98cdfdaa880 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:31.932734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:31.933141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:31.933315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:31.956845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:31.958829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:31.961497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.131483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 776/1551] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:32.132395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.146504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.177885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.178897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.179182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.179459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.180719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.182204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.198663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee09e0-9964-4da3-b5fe-f37ae2638085 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:32.207447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.209597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.210089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.210606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] PATH_INFO: `/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.213437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb896b4e1c546d689d01f4a8a66ba62)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.219484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.241825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 776/1552] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:31 2022] POST /identity/v3/users => generated 290 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:32.242889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.246470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.353018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb896b4e1c546d689d01f4a8a66ba62', 'request_id': 'req-251868f4-ae2f-41b5-b47f-2c16e9e1505c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.378919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb896b4e1c546d689d01f4a8a66ba62', 'request_id': 'req-251868f4-ae2f-41b5-b47f-2c16e9e1505c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.410560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb896b4e1c546d689d01f4a8a66ba62', 'request_id': 'req-251868f4-ae2f-41b5-b47f-2c16e9e1505c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.420589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:32.442970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] The token cache is being invalidate because project 5bb896b4e1c546d689d01f4a8a66ba62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:32.443514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.444555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.448378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 777/1553] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:32 2022] DELETE /identity/v3/projects/5bb896b4e1c546d689d01f4a8a66ba62 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:32.452444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.457972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e6b9-8a1a-4488-8d83-df5996701991 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:32.459634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.593066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.595077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.596483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.597219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.602442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.634222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251868f4-ae2f-41b5-b47f-2c16e9e1505c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:32.637090 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.642145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.656201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.657278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.657785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.658258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.659123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.662010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378ed1c-2f7a-45be-837f-0478b80ce27a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.670691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 777/1554] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:32.671742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.676507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.677187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 778/1555] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:32.680170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.680817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.681331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.709149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766df75e-b8b0-4189-915a-7daf4221f822 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:32.724147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.725747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.726069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.727758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] PATH_INFO: `/v3/users/79b279e3124b472dae465b57d849bcef` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.728353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:32.730270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.730511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b279e3124b472dae465b57d849bcef)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.735543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.750970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 779/1556] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:32.753553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.783541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040785bd-72c5-45bb-9bfd-e1eae7a98ba2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:32.790334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:32.795478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.796304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.796826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.797735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:32.799610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd0251-10a7-45ee-ac03-5068873058ce admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:32.824860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 780/1557] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:32.829166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:32.831680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:32.832310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:32.842520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b279e3124b472dae465b57d849bcef'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.861988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b279e3124b472dae465b57d849bcef'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.863086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b279e3124b472dae465b57d849bcef'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.868124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b279e3124b472dae465b57d849bcef'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.873366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:32.874885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:32.882770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b279e3124b472dae465b57d849bcef'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:32.883072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.910220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 781/1558] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:32.913767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.917997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 778/1559] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:32 2022] DELETE /identity/v3/users/79b279e3124b472dae465b57d849bcef => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:32.924664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:32.928479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:32.964220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458601-4619-430b-a7b9-e6a52fceee03 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.050986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe92640-8f0f-4565-811c-9dd0787f3126 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.069495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.070168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.072739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.073845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.074618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:33.074935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.076729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217956d-19de-45e8-b7a7-cd1b840b72ca admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.113609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 779/1560] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:33.115165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.115465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.115734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.153406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.153999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.161375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.161756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] PATH_INFO: `/v3/projects/2639f7982a4545c2a49687cda707c436/users/ed4de589d94647f68df22ec3cc29a814/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.170535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:33.174298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:33.199753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 780/1561] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:33.199753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.200729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2639f7982a4545c2a49687cda707c436, user_id=ed4de589d94647f68df22ec3cc29a814, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.204859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.229845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4af05-5ad7-4dca-b865-e1c068c9d4a8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.231645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 782/1562] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:32 2022] PUT /identity/v3/projects/2639f7982a4545c2a49687cda707c436/users/ed4de589d94647f68df22ec3cc29a814/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:33.243178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.247833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:33.336152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:33.346078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d18a7a-2c05-48f0-b6e5-37777fa144c5 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.349527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.350196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.350476 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.350766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.351416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.353629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e775-6735-4c9d-813f-09203717130d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.361738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.363891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.364713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.365504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.388029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.392996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.397796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 781/1563] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:33.399861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.400459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.401071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.412553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 783/1564] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:33.413255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.424468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4e8e-9d2c-40d0-8c81-423b2d01ad26 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.436815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] MFA Rules not processed for user `ed4de589d94647f68df22ec3cc29a814`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:33.438348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:33.491682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:33.539023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.539744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.540255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.540735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.542860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.547276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.547726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 782/1565] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:33.553352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.595877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 784/1566] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:33.600429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.602282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a500c8-b420-4bb6-bfb4-2bc3eff1af57 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.615229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.617475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.618008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.618517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.620088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.624263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.634623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8406fbb-b4e1-4f12-a793-f7671302d9d6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.656569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.657686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.658147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.658688 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.659998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.664562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.691228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 785/1567] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:33.691228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.693282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:33.696085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 783/1568] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:33.698686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.719054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0489ae-b8b6-4c36-96e3-a85c0bbd51b5 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.798573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47d93-2312-4aa4-8c90-00caf920fda8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.798573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.798573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.798573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.800045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.800045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.800045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.810589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 784/1569] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:33.811830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.826390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92878cc9-1c94-4125-9b0a-2b8017bdb27b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.836672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.837548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.839250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.839601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.840346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.842737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.886892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.888291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.888863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.889370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] PATH_INFO: `/v3/projects/4f77151ea6864bf0963ced7213e45030` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.891211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f77151ea6864bf0963ced7213e45030)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.896501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:33.904822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 785/1570] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:33 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:33.907055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:33.933898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d033ce-c31d-44c2-b399-7524026f4769 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:33.939641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:33.940402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:33.941182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:33.941550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] PATH_INFO: `/v3/projects/09cdb109f1f34d16b630bb3689e96065/users/6ba185d144404b5aae78d2721ece60ed/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:33.968918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cdb109f1f34d16b630bb3689e96065, user_id=6ba185d144404b5aae78d2721ece60ed, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:33.971863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:34.004771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 786/1571] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:33 2022] PUT /identity/v3/projects/09cdb109f1f34d16b630bb3689e96065/users/6ba185d144404b5aae78d2721ece60ed/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:34.019844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.080096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f77151ea6864bf0963ced7213e45030', 'request_id': 'req-24433ec3-0e6f-4603-9447-9f04ac58d6d4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.105929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f77151ea6864bf0963ced7213e45030', 'request_id': 'req-24433ec3-0e6f-4603-9447-9f04ac58d6d4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.131013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f77151ea6864bf0963ced7213e45030', 'request_id': 'req-24433ec3-0e6f-4603-9447-9f04ac58d6d4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.152110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:34.172986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] The token cache is being invalidate because project 4f77151ea6864bf0963ced7213e45030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:34.174208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.188498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24433ec3-0e6f-4603-9447-9f04ac58d6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.195311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 786/1572] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:33 2022] DELETE /identity/v3/projects/4f77151ea6864bf0963ced7213e45030 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:34.198057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:34.198937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:34.199420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:34.242863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da723e8-40c4-4152-905c-d981179a9c45 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:34.264309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] MFA Rules not processed for user `6ba185d144404b5aae78d2721ece60ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:34.267324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.280435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:34.394003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 787/1573] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:34.394939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.396441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.450767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:34.450767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:34.450767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:34.451329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:34.455859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:34.458515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:34.480596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 787/1574] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:34.481527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.483462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.602349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7caa-8763-4edf-9583-f3153249426a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:34.610400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88f34-88ef-4d6a-ba08-8d28d7f8708e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:34.615739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:34.616453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:34.616734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:34.617019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] PATH_INFO: `/v3/users/d7b7b86125ba40a99069d15c82176be2` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:34.617207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:34.618104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:34.618386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:34.618957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:34.619945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b7b86125ba40a99069d15c82176be2)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:34.622122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:34.633004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:34.634587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:34.656368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 788/1575] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:34.657641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.662720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.694289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c77bf-9d50-44b5-88df-bbe1ab3fa3c8 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:34.706926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:34.707676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:34.708035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:34.721496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] PATH_INFO: `/v3/projects/93761816936440169600fd6854e25370/users/5f50cb9199aa46efbac8b4dcba04292d/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:34.739648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b7b86125ba40a99069d15c82176be2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.750745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93761816936440169600fd6854e25370, user_id=5f50cb9199aa46efbac8b4dcba04292d, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:34.764588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:34.769869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b7b86125ba40a99069d15c82176be2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.772235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b7b86125ba40a99069d15c82176be2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.773838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b7b86125ba40a99069d15c82176be2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.788474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 789/1576] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:34 2022] PUT /identity/v3/projects/93761816936440169600fd6854e25370/users/5f50cb9199aa46efbac8b4dcba04292d/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:34.789415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.791321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.799460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b7b86125ba40a99069d15c82176be2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:34.847805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 788/1577] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:34 2022] DELETE /identity/v3/users/d7b7b86125ba40a99069d15c82176be2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:34.855139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:34.858510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:34.884693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:34.953161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab5d44-f513-4e48-ac6a-d101c2ea4ae1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:35.040708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f909b-d3f3-4bce-bc7a-e0098e8d0166 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:35.053698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:35.056241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.056832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.057297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.058882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:35.062325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:35.073086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:35.135278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 789/1578] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:35.139001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:35.143927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:35.190874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:35.200494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.200996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.205996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12164dfa-ce45-4f4e-abdb-b19dbfefd7f3 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:35.206911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] PATH_INFO: `/v3/users/6ba185d144404b5aae78d2721ece60ed` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.215040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba185d144404b5aae78d2721ece60ed)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:35.217181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:35.218354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.219151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.220030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] PATH_INFO: `/v3/projects/67f8e5c8d12f485485ea5a5cc6427b16` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.222365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f8e5c8d12f485485ea5a5cc6427b16)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:35.225104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:35.227694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:35.409966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f8e5c8d12f485485ea5a5cc6427b16', 'request_id': 'req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.437556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f8e5c8d12f485485ea5a5cc6427b16', 'request_id': 'req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.457863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f8e5c8d12f485485ea5a5cc6427b16', 'request_id': 'req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.501654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] The token cache is being invalidate because project 67f8e5c8d12f485485ea5a5cc6427b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:35.503630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.508272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.513464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 790/1579] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:35 2022] DELETE /identity/v3/projects/67f8e5c8d12f485485ea5a5cc6427b16 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:35.520534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:35.523028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:35.528518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba185d144404b5aae78d2721ece60ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.560516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba185d144404b5aae78d2721ece60ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.561769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba185d144404b5aae78d2721ece60ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.565387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba185d144404b5aae78d2721ece60ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.587263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba185d144404b5aae78d2721ece60ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.669006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f4c4-e91e-45fa-9a63-f479d04deb53 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:35.678348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:35.678348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.678348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.678348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] PATH_INFO: `/v3/projects/93761816936440169600fd6854e25370/users/5f50cb9199aa46efbac8b4dcba04292d/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.680107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=93761816936440169600fd6854e25370, user_id=5f50cb9199aa46efbac8b4dcba04292d, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:35.683928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154d641-24a4-4d97-8b5f-e2bf56a100ba admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:35.692092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 790/1580] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:34 2022] DELETE /identity/v3/users/6ba185d144404b5aae78d2721ece60ed => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:35.694516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:35.697543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:35.700227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 791/1581] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:35 2022] PUT /identity/v3/projects/93761816936440169600fd6854e25370/users/5f50cb9199aa46efbac8b4dcba04292d/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:35.701294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a7b2-639b-4562-a84b-8197d54df580 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.701926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a7b2-639b-4562-a84b-8197d54df580 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.702203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a7b2-639b-4562-a84b-8197d54df580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.747539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-90d5a7b2-639b-4562-a84b-8197d54df580 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:35.748975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-90d5a7b2-639b-4562-a84b-8197d54df580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:35.772565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:35.888140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a9d3-b7be-4946-9ba1-d2b562eba93d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:35.893562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:35.894361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.894647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.894916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] PATH_INFO: `/v3/users/8a3b578b9aaa4a6896d62760372334d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.896168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3b578b9aaa4a6896d62760372334d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:35.898289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 792/1582] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:35.898435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:35.906689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:35.907395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:35.908205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:35.957961 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] MFA Rules not processed for user `5f50cb9199aa46efbac8b4dcba04292d`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:35.959276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:35.974666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3b578b9aaa4a6896d62760372334d1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.985644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3b578b9aaa4a6896d62760372334d1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.986271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3b578b9aaa4a6896d62760372334d1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.986974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3b578b9aaa4a6896d62760372334d1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:35.992122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:35.998615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3b578b9aaa4a6896d62760372334d1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.033839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 791/1583] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:35 2022] DELETE /identity/v3/users/8a3b578b9aaa4a6896d62760372334d1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:36.036356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.039599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.140644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 793/1584] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:36.142706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.145198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.249710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0f04f-1e91-41f1-afdf-a30ad867bb8c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.257992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.259445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.261167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.261617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] PATH_INFO: `/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.263421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2104f5d5363b4c0d9179f1a61cd69a4a)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:36.266096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:36.340656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fee8d9-6ed0-4966-8948-2e5b49e562fc None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.377232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2104f5d5363b4c0d9179f1a61cd69a4a', 'request_id': 'req-a68526e1-8184-4ff1-8d56-756662ed3484'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.393020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2104f5d5363b4c0d9179f1a61cd69a4a', 'request_id': 'req-a68526e1-8184-4ff1-8d56-756662ed3484'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.410762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2104f5d5363b4c0d9179f1a61cd69a4a', 'request_id': 'req-a68526e1-8184-4ff1-8d56-756662ed3484'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.450532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] The token cache is being invalidate because project 2104f5d5363b4c0d9179f1a61cd69a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:36.452760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.455868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:36.461000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 792/1585] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:36 2022] DELETE /identity/v3/projects/2104f5d5363b4c0d9179f1a61cd69a4a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:36.463087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.466185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.480279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.481148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.481295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.481563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.484261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.505624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:36.507623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aaa21-8b30-44d2-b016-ef1a4dc53a35 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:36.522543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 794/1586] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:36.524113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382e29-de7a-43a7-989d-a648c6d9cf92 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.524392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382e29-de7a-43a7-989d-a648c6d9cf92 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.524715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382e29-de7a-43a7-989d-a648c6d9cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.545116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:36.555602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-53382e29-de7a-43a7-989d-a648c6d9cf92 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:36.558157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-53382e29-de7a-43a7-989d-a648c6d9cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.600614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68526e1-8184-4ff1-8d56-756662ed3484 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.608693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.610615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.611143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.611663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.615996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.654686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:36.694089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 795/1587] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:36.706589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.707442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.708562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.741839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:36.743444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:36.756462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 793/1588] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:36.770506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:36.777462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.812776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.813335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 796/1589] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:36.833326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811209-a0fa-42da-9e69-8e9540f5ab73 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.845501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.847421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.852006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.852774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.853125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.853754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.856260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:36.856666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:36.862550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:36.864703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad2129-caed-4e55-8f89-1d7881677c73 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.870201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.870896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.871183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.871459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.873933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:36.892838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 794/1590] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:36.899452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:36.933374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358823a2-92bd-4fa9-a784-3f15f300cfd0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:36.952597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:36.953393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:36.953793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:36.954165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:36.954928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:36.957912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.037159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:37.044187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.064357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 795/1591] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:36 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:37.072683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 797/1592] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:37.077837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:37.266846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201858-b1bd-45c6-871c-0aaba372beb6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:37.278191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:37.279607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:37.280524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:37.282106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:37.289368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:37.289368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.340428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 796/1593] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:37 2022] POST /identity/v3/users => generated 279 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:37.347884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:37.390260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746428-c974-44b8-9eb9-02aaf50f3b0d service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:37.416301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:37.417778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:37.418239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:37.418708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:37.419895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:37.423906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.446683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 798/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:37.452475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:37.479640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443615c-b986-4c76-908c-da60dd113ce3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:37.491454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:37.493243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:37.493764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:37.494537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:37.496070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:37.516364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787fe6d-b40f-4a6b-a3c4-3e3f2ef8d38d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.560428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:37.571463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 797/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:37.584852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62f71-6880-424e-acaa-5029fd521e86 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:37.614801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:37.618351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:37.620296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:37.620894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] PATH_INFO: `/v3/projects/b0bbf1031faa45beb36cf078f8a57b26/users/238a120757434ba6bc5458e9593a23c7/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:37.724781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bbf1031faa45beb36cf078f8a57b26, user_id=238a120757434ba6bc5458e9593a23c7, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:37.737673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:37.816418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 799/1596] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:37 2022] PUT /identity/v3/projects/b0bbf1031faa45beb36cf078f8a57b26/users/238a120757434ba6bc5458e9593a23c7/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:37.828305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:37.829180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:37.829629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:37.895441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] MFA Rules not processed for user `238a120757434ba6bc5458e9593a23c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:37.899197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:38.029029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:38.124955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:38.125118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 798/1597] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:38.392572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5bce-bc42-4728-b919-8a74a53921ee admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:38.400778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:38.402070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:38.402781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:38.403836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:38.405501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:38.409196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:38.426908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:38.476320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 800/1598] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:38 2022] POST /identity/v3/projects => generated 355 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:38.478322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:38.501412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9851f-7db9-4abb-b50f-558057d11724 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:38.540099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:38.543825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:38.611133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:38.611880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:38.612552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:38.612897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:38.614423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:38.616737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:38.647622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 799/1599] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:38 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:38.648787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:38.652431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:38.669533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8a27-fab2-4e03-8b01-938527b02660 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:38.677069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:38.678058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:38.678396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:38.678736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] PATH_INFO: `/v3/projects/e75aff4df16d491da112a95f254116f8` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:38.680336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75aff4df16d491da112a95f254116f8)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:38.685898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:38.726400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd76d-ec3f-4a78-ba84-0b1a4f7c8d9c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:38.732580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:38.733263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:38.733544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:38.733902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] PATH_INFO: `/v3/projects/09cdb109f1f34d16b630bb3689e96065` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:38.735231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cdb109f1f34d16b630bb3689e96065)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:38.737513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:38.791982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75aff4df16d491da112a95f254116f8', 'request_id': 'req-23c99b7a-c440-410c-a441-2c5f0a28c450'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.808307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75aff4df16d491da112a95f254116f8', 'request_id': 'req-23c99b7a-c440-410c-a441-2c5f0a28c450'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.820240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cdb109f1f34d16b630bb3689e96065', 'request_id': 'req-b00dc2c3-6870-47ad-aad8-ee33b1432e30'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.827705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75aff4df16d491da112a95f254116f8', 'request_id': 'req-23c99b7a-c440-410c-a441-2c5f0a28c450'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.836231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cdb109f1f34d16b630bb3689e96065', 'request_id': 'req-b00dc2c3-6870-47ad-aad8-ee33b1432e30'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.859945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cdb109f1f34d16b630bb3689e96065', 'request_id': 'req-b00dc2c3-6870-47ad-aad8-ee33b1432e30'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.860232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] The token cache is being invalidate because project e75aff4df16d491da112a95f254116f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:38.860232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.860232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.866055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 800/1600] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:38 2022] DELETE /identity/v3/projects/e75aff4df16d491da112a95f254116f8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:38.866055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:38.869594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] The token cache is being invalidate because project 09cdb109f1f34d16b630bb3689e96065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:38.869985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.870528 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:38.870855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b00dc2c3-6870-47ad-aad8-ee33b1432e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:38.876060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 801/1601] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:38 2022] DELETE /identity/v3/projects/09cdb109f1f34d16b630bb3689e96065 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:38.876060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:38.876060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:38.876060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:38.911323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:38.912863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:38.977132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99b7a-c440-410c-a441-2c5f0a28c450 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:38.994586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:39.071086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.072011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.073176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.073176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.073788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.075588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5e9ef-b5db-4100-a5ac-181f930f8956 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.088839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 801/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:39.090146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 802/1603] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:39.091290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255128-525a-448d-be11-d7ea0abac27f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.091677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255128-525a-448d-be11-d7ea0abac27f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.092523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255128-525a-448d-be11-d7ea0abac27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.093869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.098676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:39.125672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04902aea-4ae1-4cac-a420-3ba12696e9a9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.131327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-68255128-525a-448d-be11-d7ea0abac27f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:39.133624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-68255128-525a-448d-be11-d7ea0abac27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:39.138895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.139745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.140214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.140676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] PATH_INFO: `/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f/users/017160bba82042ebb553e1c22447c614/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.165155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 802/1604] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:39.165155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.165155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.165155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.179382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c690a9a8f31c49eeb0c7311ee990e53f, user_id=017160bba82042ebb553e1c22447c614, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.185263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde8c6-4d1a-4eba-ac50-1f58767b7ea1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.191189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:39.200702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:39.202430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:39.221587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 803/1605] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:39 2022] PUT /identity/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f/users/017160bba82042ebb553e1c22447c614/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:39.221587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.221587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.221587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.273722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:39.275180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:39.392339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 804/1606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:39.395579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.421471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6469-145f-4ee0-b358-ded6e374cbeb None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.431923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.433073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.433748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.434239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.435555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.439413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.446399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 803/1607] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:39.451182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.472754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 805/1608] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:39.472754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.481890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6769d-1509-4328-b9f4-2c0f916dff83 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.499689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.500385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.500677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.500957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.504432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:39.506061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.510603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.538728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1b78-9178-4965-a343-3ebfd7200fee admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.554356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 804/1609] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:39.554356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.574917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d453b0-0385-463d-a036-368df1625524 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.576310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.577309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.577739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.578441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.579679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:39.580247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.589522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.590234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.590391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.591272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.591547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] PATH_INFO: `/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f/users/017160bba82042ebb553e1c22447c614/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.597163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c690a9a8f31c49eeb0c7311ee990e53f, user_id=017160bba82042ebb553e1c22447c614, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.606436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.642528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 806/1610] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:39.644820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.650299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 805/1611] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:39 2022] PUT /identity/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f/users/017160bba82042ebb553e1c22447c614/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:39.663721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.669120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d984e-0cfb-40be-83f5-a3e941e69d01 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.834080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3b11d-59a1-4462-b369-532dad51d310 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:39.849740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.850551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.850863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.851288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.852134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.861885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.862114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:39.862731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.862731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.862997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.863826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:39.865799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9917f-7539-4b0a-b9b9-3b6b15ca33a8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:39.920393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 807/1612] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/projects => generated 361 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:39.920393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:39.920393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:39.920393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:39.923211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:39.943914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 806/1613] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/projects => generated 399 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:39.946455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:39.970252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] MFA Rules not processed for user `017160bba82042ebb553e1c22447c614`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:39.974572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.122379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:40.170951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043daa92-b475-4ceb-b27e-0c08201ae960 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.179609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.180772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.181110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.181428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.182710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.182940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 808/1614] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:40.185732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.188077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.219521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68accd2e-df1b-42b7-af79-20dd3cd0e5e9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.230111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.231527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.232230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.233937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.233937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.235872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.249484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 807/1615] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:39 2022] POST /identity/v3/users => generated 281 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:40.250497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.252373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.281506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 809/1616] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:40 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:40.282815 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.297808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54b6e-96d9-4140-8d1c-90541ac98d5c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.303763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.304520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.304801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.305072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.305745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.307937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.321051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 810/1617] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:40.322065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.332917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39313c-ced4-4163-bf1b-b4662cdefd63 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.338055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d77f4-80a5-437c-b494-d7d8a52b59d1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.338580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.339321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.339694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.340101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.340768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.342486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.343845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.344594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.346060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.346349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.361184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.363255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.367220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 811/1618] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:40.368532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.377220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 808/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:40.378307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.395778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed516ec-3431-4f2b-a46a-795ea7923f24 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.397787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b4c0-4b87-442f-80d7-e7409743de3b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.401426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.402170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.402455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.402730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.403385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.405232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.416703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.417337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.417615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.417885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.420687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.424121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.430334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 809/1620] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:40.434562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.440076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 812/1621] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:40.444404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.448034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3f7f-c455-4512-aea9-f6ecb9ad2c29 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.453539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.454444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.454880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.455307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] PATH_INFO: `/v3/projects/6b6c121f1a694d0499a3497a37a6bea2/users/8cce2b0b892c42d9892c99b18c9e5234/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.456591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960f46f-dc88-456a-8d66-f3f70071a611 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.462607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.463427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.464064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.464439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] PATH_INFO: `/v3/projects/496c0ba09ed149a5b61aa3dc229b4fce/users/be6cac5eac0b4d45b2689638338dad70/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.478974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6c121f1a694d0499a3497a37a6bea2, user_id=8cce2b0b892c42d9892c99b18c9e5234, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.483088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.498329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496c0ba09ed149a5b61aa3dc229b4fce, user_id=be6cac5eac0b4d45b2689638338dad70, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.501608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0894e-b021-45f3-ab73-92ceb5622f99 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.508493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 810/1622] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:40 2022] PUT /identity/v3/projects/6b6c121f1a694d0499a3497a37a6bea2/users/8cce2b0b892c42d9892c99b18c9e5234/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:40.519506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.521638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 813/1623] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:40 2022] PUT /identity/v3/projects/496c0ba09ed149a5b61aa3dc229b4fce/users/be6cac5eac0b4d45b2689638338dad70/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:40.523177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475711-d918-4dc6-a28a-fa829a8f3b9e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.523587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475711-d918-4dc6-a28a-fa829a8f3b9e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.523978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475711-d918-4dc6-a28a-fa829a8f3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.563716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c1475711-d918-4dc6-a28a-fa829a8f3b9e None None] MFA Rules not processed for user `8cce2b0b892c42d9892c99b18c9e5234`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:40.565377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c1475711-d918-4dc6-a28a-fa829a8f3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.583353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecac63-4a3e-44fc-803d-2f5219b48686 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.595548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:40.640196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.640737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.641011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.641282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.643323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.648491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 814/1624] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:40.649861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.650148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.650704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.691849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] MFA Rules not processed for user `be6cac5eac0b4d45b2689638338dad70`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:40.692853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.742501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.744079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.754389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 811/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:40.755077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.766949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:40.789228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 815/1626] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:40.831747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.833664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:40.848875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e728e5-98c6-4a0a-a6e6-845dff383510 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.855084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.855733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.856085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.856348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.871480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.874217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.878283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161f19-d09f-418d-aef6-353376c2bc9a service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.884373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.885042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.885468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.885795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.886624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.888824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 816/1627] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:40.896547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.905700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:40.921518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526beab-ab19-41eb-a5eb-0d362d078ae4 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:40.928382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:40.929322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:40.929700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:40.930132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] PATH_INFO: `/v3/users/be6cac5eac0b4d45b2689638338dad70` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:40.936526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6cac5eac0b4d45b2689638338dad70)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:40.936526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:40.954112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 812/1628] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:40 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:40.958467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.025009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6cac5eac0b4d45b2689638338dad70'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.034571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6cac5eac0b4d45b2689638338dad70'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.035479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6cac5eac0b4d45b2689638338dad70'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.037868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6cac5eac0b4d45b2689638338dad70'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.058449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:41.065651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4d215834-2de5-4b59-b81d-900cb3870b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6cac5eac0b4d45b2689638338dad70'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.078384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3990d7-7319-42ab-be74-5c7267cf0d68 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.089010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.089010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.089010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.089010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.089990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.107012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.107710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 817/1629] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:40 2022] DELETE /identity/v3/users/be6cac5eac0b4d45b2689638338dad70 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:41.110162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.110647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.111114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.151703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 813/1630] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:40 2022] POST /identity/v3/users => generated 307 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:41.153373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:41.154656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.158573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.160364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.178249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0e776-faef-4891-bccd-1f752d991df4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.279084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 818/1631] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:41.305836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.306853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.351613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.352311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.352595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.352871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.353607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.356318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.386756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 814/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:41.388343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.415470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b154c-8799-47a8-bf3a-11214328cf99 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.421638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.422351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.422635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.422915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] PATH_INFO: `/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700/users/4d621bc514004fc4a42216057eee4bba/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.456430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af08d64cd5ea4525b1f31bc1d7abc700, user_id=4d621bc514004fc4a42216057eee4bba, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.459182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.473107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:41.490756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 815/1633] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:41 2022] PUT /identity/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700/users/4d621bc514004fc4a42216057eee4bba/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:41.493050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.510448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.512598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c200ff8-be21-40f3-965c-041f299dcf40 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.606656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.607399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.607550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.607919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.618041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a403c-f4b1-4182-979b-71efd5c5b2c4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.623381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.624194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.624323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.624497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.624773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] PATH_INFO: `/v3/users/80e1c48c337047888bde35b710a4e149` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.625948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.626086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e1c48c337047888bde35b710a4e149)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.627870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.636662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 819/1634] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:41.637367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.648996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627023-f25c-4b0c-8fe2-79d1c22104b9 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.657076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.657629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.657903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.658167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.658810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.660462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.672568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 820/1635] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:41.676897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.690263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5b35-2667-4917-b0aa-2107650981e0 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:41.696467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:41.697358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.697633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.697921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] PATH_INFO: `/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700/users/4d621bc514004fc4a42216057eee4bba/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.700806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af08d64cd5ea4525b1f31bc1d7abc700, user_id=4d621bc514004fc4a42216057eee4bba, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:41.707212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096efc-fef7-443f-ba60-9c14780dfa53 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:41.724645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e1c48c337047888bde35b710a4e149'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.734352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e1c48c337047888bde35b710a4e149'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.735638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e1c48c337047888bde35b710a4e149'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.736509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e1c48c337047888bde35b710a4e149'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.740899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 821/1636] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:41 2022] PUT /identity/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700/users/4d621bc514004fc4a42216057eee4bba/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:41.748440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:41.756207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-75707975-ad1d-4f62-b0a9-6f8853835067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e1c48c337047888bde35b710a4e149'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:41.757774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.758273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.758771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.805154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] MFA Rules not processed for user `4d621bc514004fc4a42216057eee4bba`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:41.807273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.821965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 816/1637] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:41 2022] DELETE /identity/v3/users/80e1c48c337047888bde35b710a4e149 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:41.829328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:41.829772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:41.830139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:41.861704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:41.864060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.910684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 822/1638] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:41.923294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:41.926215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:41.987215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 817/1639] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:42.009786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:42.013861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.037022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12943d-427b-4cfe-beda-6837a9a11697 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.082318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:42.151112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.152122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.152595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.153307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.186786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63309b67-ce92-446b-ba98-9642cc227f5a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.193689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.194426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.195317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.195596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.223965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.226587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.258547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 818/1640] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:42.260846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:42.263574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.291964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.293276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ea67-b568-4358-8e10-4e7fa7f57949 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.294772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.306682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.307318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.307595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.308056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] PATH_INFO: `/v3/projects/496c0ba09ed149a5b61aa3dc229b4fce` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.309447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=496c0ba09ed149a5b61aa3dc229b4fce)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.316839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.324651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 823/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:42.465756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496c0ba09ed149a5b61aa3dc229b4fce', 'request_id': 'req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:42.477405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496c0ba09ed149a5b61aa3dc229b4fce', 'request_id': 'req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:42.492183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496c0ba09ed149a5b61aa3dc229b4fce', 'request_id': 'req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:42.499466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:42.501435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.519279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:42.533235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] The token cache is being invalidate because project 496c0ba09ed149a5b61aa3dc229b4fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:42.533392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:42.536386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4c4669d2-7f8b-4afc-acfe-12abfb052d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:42.544358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225dc8-28ff-4a8b-8740-06059a82fc10 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.547893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 819/1642] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:42 2022] DELETE /identity/v3/projects/496c0ba09ed149a5b61aa3dc229b4fce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:42.554270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae946d9-ab0f-4c6e-9a44-135ec23c471d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.556623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae946d9-ab0f-4c6e-9a44-135ec23c471d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.557109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae946d9-ab0f-4c6e-9a44-135ec23c471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.628942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7ae946d9-ab0f-4c6e-9a44-135ec23c471d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:42.630832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7ae946d9-ab0f-4c6e-9a44-135ec23c471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.719748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.720461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.720747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.721019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.726307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.755852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 820/1643] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:42.760522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.761258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.761942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.829573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:42.831453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.878690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 821/1644] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:42.879706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:42.912967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.917510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.920811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468697-fe8d-492e-865e-3e2e28b51a8b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.928770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 824/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:42.929617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:42.940550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.941199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.942359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.942638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.944684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:42.944809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:42.946691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.952157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.964483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b704b0-a985-482a-8264-22e3b588b6f3 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:42.972710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:42.973808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:42.974308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:42.974579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] PATH_INFO: `/v3/projects/f544985d78a9482cbccef12ee5816533` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:42.976224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f544985d78a9482cbccef12ee5816533)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:42.978757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:42.987397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 822/1646] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:42.989463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.006234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed3ddb-c69b-4860-957a-12a447b1334b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.020309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:43.024755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.026250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.029102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.029752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.031231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.036210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.091999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f544985d78a9482cbccef12ee5816533', 'request_id': 'req-283e5164-c186-4b20-93cb-d1a381a9d1c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.109640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 823/1647] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:42 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:43.111758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.112616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f544985d78a9482cbccef12ee5816533', 'request_id': 'req-283e5164-c186-4b20-93cb-d1a381a9d1c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.125040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f544985d78a9482cbccef12ee5816533', 'request_id': 'req-283e5164-c186-4b20-93cb-d1a381a9d1c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.173956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] The token cache is being invalidate because project f544985d78a9482cbccef12ee5816533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:43.174429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.176455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.184690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 825/1648] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:42 2022] DELETE /identity/v3/projects/f544985d78a9482cbccef12ee5816533 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:43.192294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.195089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:43.274218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a636-ec3f-4693-bf4a-eb59e7e22808 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.281695 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.283490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.283976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.284327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.285067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.287594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.329566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 824/1649] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:43 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:43.335650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.344067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:43.368371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2acd2-d1f2-40c1-a92d-489dd4e45522 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.375633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.376047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.376316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.376588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.377272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.378933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.398956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 825/1650] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:43.403373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.425378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e5164-c186-4b20-93cb-d1a381a9d1c6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.427922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d51a6-10a3-4257-84ac-ddf44613f24d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.436989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.438533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.438629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.440825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.443116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.446580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.450040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.450371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.450855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.451305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] PATH_INFO: `/v3/users/ed4de589d94647f68df22ec3cc29a814` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.460746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4de589d94647f68df22ec3cc29a814)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.465494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.490621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 826/1651] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:43.492618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:43.523488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c732bf-be5c-45f8-857e-8a757edad65d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:43.545680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:43.546689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.546956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.547268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] PATH_INFO: `/v3/projects/96575d6d904845c58f4e88d0cc603e64/users/d675909879bf461b89854f89cb71caf5/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.606977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96575d6d904845c58f4e88d0cc603e64, user_id=d675909879bf461b89854f89cb71caf5, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:43.633235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e072-1db5-4aaf-84e5-36bd66d1ea6d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:43.652737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4de589d94647f68df22ec3cc29a814'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.686600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 827/1652] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:43 2022] PUT /identity/v3/projects/96575d6d904845c58f4e88d0cc603e64/users/d675909879bf461b89854f89cb71caf5/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:43.687465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4de589d94647f68df22ec3cc29a814'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.690687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4de589d94647f68df22ec3cc29a814'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.691776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4de589d94647f68df22ec3cc29a814'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.698753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:43.699270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:43.700902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:43.708546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4de589d94647f68df22ec3cc29a814'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:43.737375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 826/1653] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:43 2022] DELETE /identity/v3/users/ed4de589d94647f68df22ec3cc29a814 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:43.746622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:43.835965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] MFA Rules not processed for user `d675909879bf461b89854f89cb71caf5`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:43.837916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:44.016423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 828/1654] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:44.029664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:44.033259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:44.099902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:44.137572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996778e-5cb2-46b2-8d8f-adc60bc6a0ea admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:44.142960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:44.143658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:44.143987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:44.145217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:44.163931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:44.165620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:44.200561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 827/1655] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:44.594085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:44.595834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:44.720051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05abd6-0686-4025-a242-673b6a49b337 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:44.738016 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:44.738711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:44.738991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:44.739265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] PATH_INFO: `/v3/projects/2639f7982a4545c2a49687cda707c436` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:44.740553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2639f7982a4545c2a49687cda707c436)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:44.742510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:44.836390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2639f7982a4545c2a49687cda707c436', 'request_id': 'req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:44.848185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2639f7982a4545c2a49687cda707c436', 'request_id': 'req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:44.859120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2639f7982a4545c2a49687cda707c436', 'request_id': 'req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:44.888857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] The token cache is being invalidate because project 2639f7982a4545c2a49687cda707c436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:44.889361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:44.891057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:44.893367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 829/1656] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:44 2022] DELETE /identity/v3/projects/2639f7982a4545c2a49687cda707c436 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:44.897936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:44.916716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340f25f-93ab-4808-a36c-0992691845e2 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:45.010850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:45.011361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:45.011667 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:45.012476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] PATH_INFO: `/v3/users/5f50cb9199aa46efbac8b4dcba04292d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:45.013282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f50cb9199aa46efbac8b4dcba04292d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:45.015952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:45.104021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f50cb9199aa46efbac8b4dcba04292d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.114208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f50cb9199aa46efbac8b4dcba04292d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.115008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f50cb9199aa46efbac8b4dcba04292d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.115635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f50cb9199aa46efbac8b4dcba04292d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.126504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c8e3c93a-bd59-4601-9174-0eb67aeba51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f50cb9199aa46efbac8b4dcba04292d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.154912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 828/1657] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:44 2022] DELETE /identity/v3/users/5f50cb9199aa46efbac8b4dcba04292d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:45.687907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:45.690736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:45.716333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2561e6-ff85-4201-a1e4-ca61704fe1e5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:45.770794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:45.868511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:45.869501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:45.869875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:45.870464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] PATH_INFO: `/v3/projects/93761816936440169600fd6854e25370` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:45.872703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93761816936440169600fd6854e25370)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:45.876315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:45.951006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93761816936440169600fd6854e25370', 'request_id': 'req-33904371-9572-44e3-bd1c-7154480f13e9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.960109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93761816936440169600fd6854e25370', 'request_id': 'req-33904371-9572-44e3-bd1c-7154480f13e9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.976441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93761816936440169600fd6854e25370', 'request_id': 'req-33904371-9572-44e3-bd1c-7154480f13e9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.993907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] The token cache is being invalidate because project 93761816936440169600fd6854e25370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:45.994824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.995370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-33904371-9572-44e3-bd1c-7154480f13e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:45.997268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 830/1658] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:45 2022] DELETE /identity/v3/projects/93761816936440169600fd6854e25370 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:46.004500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.004945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.005703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.028839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:46.030191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:46.093178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:46.124004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 829/1659] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:46.134151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.134548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.135009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.167918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:46.170844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:46.187951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 831/1660] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:46.191312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.201772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422563-6d21-4f17-b02f-798ef4227d28 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.207137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.207780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.208091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.208368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.209033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:46.209339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.211174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.228957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 830/1661] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:46.234394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.245246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b057d3a-5f5d-4a94-8a5d-2f6c98378304 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.258254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.259189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.259525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.259832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.260672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.263113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.317235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 832/1662] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:46.318492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.329894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693e64-c569-48bf-af99-16abcbcdfa11 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.405369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.406441 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.406908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.407459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.408198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.410208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.434203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 831/1663] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:46.438503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.450100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e96-8f0f-4608-b17f-8ddbfc8475b0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.456751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.458117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.458372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.458643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.459570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.461229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.476415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 833/1664] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:46.476904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.489285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc953b2-fbcc-4155-9451-1a63cff1cc12 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.496572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.497338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.497464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.497900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.498555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.501166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b182f-9b39-495c-91af-2ecf461e854d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.528237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 832/1665] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:46.545303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.545303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7213bf-e3f1-42f2-af06-bd0881fe9819 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.550161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.550984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.551338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.551748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] PATH_INFO: `/v3/projects/bf8b8780723d4773b07af9fac7f5d863/users/2e8d6a3554c44dae9a46bac0f6ddff3b/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.572442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8b8780723d4773b07af9fac7f5d863, user_id=2e8d6a3554c44dae9a46bac0f6ddff3b, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.576190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.605661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 834/1666] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:46 2022] PUT /identity/v3/projects/bf8b8780723d4773b07af9fac7f5d863/users/2e8d6a3554c44dae9a46bac0f6ddff3b/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:46.618369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.618678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.619169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.663493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] MFA Rules not processed for user `2e8d6a3554c44dae9a46bac0f6ddff3b`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:46.664782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:46.817927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 833/1667] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:46.818595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.895841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:46.921852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4d72-defe-4515-8de9-d10abc037df3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:46.932077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:46.933335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:46.933711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:46.934232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:46.935049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:46.937275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:46.969805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 835/1668] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:46.976523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:46.988820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175f02e-824c-4f47-a638-6839a3c90fc0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.040341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:47.055937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.056621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.056899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.057165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.057827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.059811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.081569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 834/1669] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:46 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:47.085719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.099136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038007a-9d30-4d0c-912b-b058e9ac926b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.106487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.107167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.107446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.107719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.108620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.110605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.124065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 836/1670] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:47.128470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.139063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316b10-edeb-4bda-8871-22e52c60f188 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.143887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.144565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.144841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.145115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] PATH_INFO: `/v3/projects/520f90ec517647038496bc28cee29cca/users/9d6c10b69f364a0eb0450bcf3968b4ca/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.165005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520f90ec517647038496bc28cee29cca, user_id=9d6c10b69f364a0eb0450bcf3968b4ca, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.169137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.185355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 835/1671] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:47 2022] PUT /identity/v3/projects/520f90ec517647038496bc28cee29cca/users/9d6c10b69f364a0eb0450bcf3968b4ca/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:47.189765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.202464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c02e-549f-454f-bd80-f597971b43d7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.275736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.276438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.276715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.277023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.277735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.279490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c255-fcf0-4c74-9be3-6f4fca9d591d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.290806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 837/1672] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:47.295050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.307262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fbf54-1f50-4372-81d9-f50a6cbbe623 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.312080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.312764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.313048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.313317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] PATH_INFO: `/v3/projects/520f90ec517647038496bc28cee29cca/users/9d6c10b69f364a0eb0450bcf3968b4ca/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.315434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520f90ec517647038496bc28cee29cca, user_id=9d6c10b69f364a0eb0450bcf3968b4ca, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.318227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.329963 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 836/1673] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:47 2022] PUT /identity/v3/projects/520f90ec517647038496bc28cee29cca/users/9d6c10b69f364a0eb0450bcf3968b4ca/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:47.340649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.340931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.341204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.377958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] MFA Rules not processed for user `9d6c10b69f364a0eb0450bcf3968b4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:47.378339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:47.477442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 838/1674] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:47.491420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.493380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:47.570082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b7b3-402e-4392-a469-0bd39ee0ec04 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.574057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.574683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.574948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.575216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.584436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.585954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.595711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 837/1675] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:47.702205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:47.703885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:47.717196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c129-577a-43ef-96b6-e00c1a1c6cc4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:47.721197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:47.721959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:47.722401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:47.722570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:47.786203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:47.820275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:47.822023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:47.833918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 839/1676] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:48.079011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.081471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.113104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.114675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.190694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faa913-e7fc-4ad3-9d65-2a25f62a0eb4 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:48.195690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:48.196474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.197030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.198107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] PATH_INFO: `/v3/users/d675909879bf461b89854f89cb71caf5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.199493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d675909879bf461b89854f89cb71caf5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:48.201732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:48.208800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc0139-e588-4f1e-950b-1e75b88d4ddc service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:48.214401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:48.215061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.215339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.215610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] PATH_INFO: `/v3/users/8cce2b0b892c42d9892c99b18c9e5234` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.216803 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cce2b0b892c42d9892c99b18c9e5234)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:48.218749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:48.257899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:48.261712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd675909879bf461b89854f89cb71caf5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.274155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd675909879bf461b89854f89cb71caf5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.274365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cce2b0b892c42d9892c99b18c9e5234'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.275374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd675909879bf461b89854f89cb71caf5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.276156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd675909879bf461b89854f89cb71caf5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.284244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cce2b0b892c42d9892c99b18c9e5234'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.285312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cce2b0b892c42d9892c99b18c9e5234'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.286226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cce2b0b892c42d9892c99b18c9e5234'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.287560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd675909879bf461b89854f89cb71caf5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.296841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d2f726c1-e78d-4397-9476-7b7a110a81c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cce2b0b892c42d9892c99b18c9e5234'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.312078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 838/1677] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:48 2022] DELETE /identity/v3/users/d675909879bf461b89854f89cb71caf5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:48.313193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.314559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.322130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 840/1678] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:48 2022] DELETE /identity/v3/users/8cce2b0b892c42d9892c99b18c9e5234 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:48.324283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1a39-3034-4873-8760-9c873a6b5073 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.324577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1a39-3034-4873-8760-9c873a6b5073 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.324849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1a39-3034-4873-8760-9c873a6b5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.344465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a2ed1a39-3034-4873-8760-9c873a6b5073 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:48.346178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a2ed1a39-3034-4873-8760-9c873a6b5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.413541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446da46-214d-43f3-be56-2801ab72ba0c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:48.464350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 841/1679] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:48.470719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869867-df42-4150-80b1-906c9441829b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.471220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869867-df42-4150-80b1-906c9441829b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.471675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869867-df42-4150-80b1-906c9441829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.481745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:48.489281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:48.490143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.490565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.491948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] PATH_INFO: `/v3/users/2e8d6a3554c44dae9a46bac0f6ddff3b` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.494231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8d6a3554c44dae9a46bac0f6ddff3b)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:48.496912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:48.499608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1d869867-df42-4150-80b1-906c9441829b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:48.502729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d869867-df42-4150-80b1-906c9441829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.516136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 842/1680] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:48.517960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869867-df42-4150-80b1-906c9441829b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.528398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d869867-df42-4150-80b1-906c9441829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.610604 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8d6a3554c44dae9a46bac0f6ddff3b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.625642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869867-df42-4150-80b1-906c9441829b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:48.628789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8d6a3554c44dae9a46bac0f6ddff3b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.629897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:48.630473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8d6a3554c44dae9a46bac0f6ddff3b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.630655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.630834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.631072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.631941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8d6a3554c44dae9a46bac0f6ddff3b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.633334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.650639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:48.651045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-dba60cb6-9888-4f0d-acba-41e47d84644d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8d6a3554c44dae9a46bac0f6ddff3b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:48.652776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:48.664177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:48.668842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 843/1681] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:48.669652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.671136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.688672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881611b-9716-4980-a890-ca71dbf729c5 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:48.699301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:48.700416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.700700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.701708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.722155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 839/1682] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:48 2022] DELETE /identity/v3/users/2e8d6a3554c44dae9a46bac0f6ddff3b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:48.726170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.729822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:48.729822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:48.731008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:48.762323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:48.763886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:48.773017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:48.774930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:48.789589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 844/1683] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:48.975552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 840/1684] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:48.989247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:48.992012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:49.012317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872cacd-552e-4264-82b3-4b523b088013 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:49.146911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:49.150325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:49.150756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:49.151267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:49.200223 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:49.204732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:49.252566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 845/1685] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:49.830596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:49.832376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:49.847164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930fda-9c5b-4026-9a00-1ad64882f8e9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:49.856680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:49.857537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:49.858759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:49.858759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] PATH_INFO: `/v3/projects/96575d6d904845c58f4e88d0cc603e64` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:49.861971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96575d6d904845c58f4e88d0cc603e64)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:49.866427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.007717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.011863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.018609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96575d6d904845c58f4e88d0cc603e64', 'request_id': 'req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.033165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96575d6d904845c58f4e88d0cc603e64', 'request_id': 'req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.040540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31855-472b-49ff-a4be-46144456dbd2 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.045910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96575d6d904845c58f4e88d0cc603e64', 'request_id': 'req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.071627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] The token cache is being invalidate because project 96575d6d904845c58f4e88d0cc603e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:50.073858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.075721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1800bdcd-db9b-45b4-b6e0-bf5e8065ac84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.082909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 841/1686] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:49 2022] DELETE /identity/v3/projects/96575d6d904845c58f4e88d0cc603e64 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:50.086229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1b9a-7f00-4d23-a408-1d2a3a67f91d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.086822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1b9a-7f00-4d23-a408-1d2a3a67f91d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.088967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1b9a-7f00-4d23-a408-1d2a3a67f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.121097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-393b1b9a-7f00-4d23-a408-1d2a3a67f91d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:50.123421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-393b1b9a-7f00-4d23-a408-1d2a3a67f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.166987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.167670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.167988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.168523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] PATH_INFO: `/v3/projects/6b6c121f1a694d0499a3497a37a6bea2` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.170160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6c121f1a694d0499a3497a37a6bea2)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.182477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.251439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:50.260104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 842/1687] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:50.271613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.272189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.272738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.273198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6c121f1a694d0499a3497a37a6bea2', 'request_id': 'req-017f0e0e-6364-46f2-91ed-904ea6b5b02f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.281072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6c121f1a694d0499a3497a37a6bea2', 'request_id': 'req-017f0e0e-6364-46f2-91ed-904ea6b5b02f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.292771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6c121f1a694d0499a3497a37a6bea2', 'request_id': 'req-017f0e0e-6364-46f2-91ed-904ea6b5b02f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.308373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] The token cache is being invalidate because project 6b6c121f1a694d0499a3497a37a6bea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:50.308932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.310405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.311492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:50.313338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 846/1688] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:50 2022] DELETE /identity/v3/projects/6b6c121f1a694d0499a3497a37a6bea2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:50.313571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.320004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.320349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.323340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:50.409683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 843/1689] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:50.415218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.417997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0e0e-6364-46f2-91ed-904ea6b5b02f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.427175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.428211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.428494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.428764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] PATH_INFO: `/v3/users/4d621bc514004fc4a42216057eee4bba` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.429089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369037a8-b2bb-4676-b82f-c98039c48cec None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.429953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d621bc514004fc4a42216057eee4bba)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.432052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.435337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.436290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.436566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.436953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.437553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:50.437910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.439819 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.458721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 844/1690] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:49:50.460707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.463830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.497295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d621bc514004fc4a42216057eee4bba'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.497449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28adaf-b2f7-4948-a24d-090dbd4c6d28 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.504134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.504792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.505351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.505351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] PATH_INFO: `/v3/projects/bf8b8780723d4773b07af9fac7f5d863` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.506474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf8b8780723d4773b07af9fac7f5d863)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.507302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d621bc514004fc4a42216057eee4bba'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.508537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d621bc514004fc4a42216057eee4bba'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.508641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.509338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d621bc514004fc4a42216057eee4bba'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.520830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d621bc514004fc4a42216057eee4bba'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.551139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 847/1691] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:50 2022] DELETE /identity/v3/users/4d621bc514004fc4a42216057eee4bba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:50.572680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.578213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.651619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8b8780723d4773b07af9fac7f5d863', 'request_id': 'req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.669140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8b8780723d4773b07af9fac7f5d863', 'request_id': 'req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.690181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8b8780723d4773b07af9fac7f5d863', 'request_id': 'req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.690965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:50.737486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] The token cache is being invalidate because project bf8b8780723d4773b07af9fac7f5d863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:50.737804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.738736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:50.742324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 845/1692] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:50 2022] DELETE /identity/v3/projects/bf8b8780723d4773b07af9fac7f5d863 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:50.746949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.748754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594916-ceda-4630-a4e7-d98de0c1f973 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.750484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:50.921003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a0fa-96ec-4475-9581-9bc40a1f10d7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:50.926653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.927684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.928022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.928305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.929030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.931070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.949711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:50.950927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:50.951378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:50.951894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] PATH_INFO: `/v3/users/9d6c10b69f364a0eb0450bcf3968b4ca` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:50.954277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6c10b69f364a0eb0450bcf3968b4ca)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:50.958638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:50.969716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 848/1693] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:50 2022] POST /identity/v3/projects => generated 367 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:50.976373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:50.980553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.015224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:51.150841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6c10b69f364a0eb0450bcf3968b4ca'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.168314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c759f8-49b1-4d79-9694-361e99d728ce admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.171473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6c10b69f364a0eb0450bcf3968b4ca'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.172669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6c10b69f364a0eb0450bcf3968b4ca'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.173948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6c10b69f364a0eb0450bcf3968b4ca'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.175101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.175764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.176125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.177714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.178446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.182150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.194339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6c10b69f364a0eb0450bcf3968b4ca'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.241668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 849/1694] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:50 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:51.243329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.249102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.257603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 846/1695] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:49:50 2022] DELETE /identity/v3/users/9d6c10b69f364a0eb0450bcf3968b4ca => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:51.259031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.279332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.285414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2380-26c7-42fe-9733-20fab9811b54 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.484171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.484171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.484171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.484171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] PATH_INFO: `/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.487448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af08d64cd5ea4525b1f31bc1d7abc700)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.490475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.496702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:51.635228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51baff-a39a-4b5a-91e6-351b69bd7244 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.647838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af08d64cd5ea4525b1f31bc1d7abc700', 'request_id': 'req-f694df0a-3325-45fb-bef7-7bd78851491f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.688661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af08d64cd5ea4525b1f31bc1d7abc700', 'request_id': 'req-f694df0a-3325-45fb-bef7-7bd78851491f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.743365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af08d64cd5ea4525b1f31bc1d7abc700', 'request_id': 'req-f694df0a-3325-45fb-bef7-7bd78851491f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.772668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] The token cache is being invalidate because project af08d64cd5ea4525b1f31bc1d7abc700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:51.773587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.775103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f694df0a-3325-45fb-bef7-7bd78851491f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:51.778260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 850/1696] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:51 2022] DELETE /identity/v3/projects/af08d64cd5ea4525b1f31bc1d7abc700 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:51.782435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.783666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ae86-6ec7-4772-828d-e30b67abffdb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.784030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ae86-6ec7-4772-828d-e30b67abffdb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.784183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.784288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ae86-6ec7-4772-828d-e30b67abffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.784559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.785448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.786479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.793005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.812304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 847/1697] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 555 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:51.816372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.819556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.825688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c688ae86-6ec7-4772-828d-e30b67abffdb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:51.827091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c688ae86-6ec7-4772-828d-e30b67abffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.845787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8538-91aa-4ad8-b166-6f9c24f39df7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.847893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 851/1698] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:51.855006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.855947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.856326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.856916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.857217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.857677 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.858549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.859482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.861523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.883663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 848/1699] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:51.889118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.895025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:51.898522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:51.913334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5169-f797-4c6f-8323-aa3f313db948 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.920751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 852/1700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:51.922660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.923591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.924485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.925156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] PATH_INFO: `/v3/projects/9e5e008e62e549ef81a0ed9880a185e5/users/3a3a9f0f4dc6490c930277de9ca935a1/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.925421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.949985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0795-9bb1-4df2-ac68-ea0f418f59d8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:51.952169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:51.952169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.952169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.952169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:51.952850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5e008e62e549ef81a0ed9880a185e5, user_id=3a3a9f0f4dc6490c930277de9ca935a1, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.954102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:51.954102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:51.955478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.955681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f093e-ddc1-4f92-ac01-e57b09b59c50 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:51.976101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 853/1701] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:51.978604 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 849/1702] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:51 2022] PUT /identity/v3/projects/9e5e008e62e549ef81a0ed9880a185e5/users/3a3a9f0f4dc6490c930277de9ca935a1/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:51.987962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:51.993960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:51.994172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:51.994858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.006026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd47d-1d6a-477f-8f81-b81dabff143d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.019298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:52.035397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] MFA Rules not processed for user `3a3a9f0f4dc6490c930277de9ca935a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:52.038128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.096523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.097492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.098024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.098447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.100514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.102746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.132124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 850/1703] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:52.132124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.132124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.152253 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 854/1704] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:51 2022] POST /identity/v3/projects => generated 407 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:52.153170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.155719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.167098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952f6a-154c-4021-9bef-5bfdefb20ba7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.255438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:52.289139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.290251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.290830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.291650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] PATH_INFO: `/v3/projects/520f90ec517647038496bc28cee29cca` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.295047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520f90ec517647038496bc28cee29cca)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.297352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.304508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637db71-3fc6-4fe1-9424-97f5a4819e95 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.309350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.310012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.310501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.310858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.385031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520f90ec517647038496bc28cee29cca', 'request_id': 'req-458cd2a7-1c3a-4222-8e9e-71a40b470125'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:52.391522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.393072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.406645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520f90ec517647038496bc28cee29cca', 'request_id': 'req-458cd2a7-1c3a-4222-8e9e-71a40b470125'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:52.409094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 855/1705] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:52.412136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.420635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520f90ec517647038496bc28cee29cca', 'request_id': 'req-458cd2a7-1c3a-4222-8e9e-71a40b470125'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:52.425910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6895d2-fef4-4898-956f-71611c86c725 service glance] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.450552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] The token cache is being invalidate because project 520f90ec517647038496bc28cee29cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:49:52.451654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:52.455967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-458cd2a7-1c3a-4222-8e9e-71a40b470125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:49:52.457807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 851/1706] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:49:52 2022] DELETE /identity/v3/projects/520f90ec517647038496bc28cee29cca => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:52.464297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb438-0780-4167-a294-6b85557d6429 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.464745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb438-0780-4167-a294-6b85557d6429 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.465254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb438-0780-4167-a294-6b85557d6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.514076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-62ccb438-0780-4167-a294-6b85557d6429 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:52.517648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-62ccb438-0780-4167-a294-6b85557d6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.580124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:52.589496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.590664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.594660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.595149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.596260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.601217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.655106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 856/1707] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:52 2022] POST /identity/v3/users => generated 304 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:52.659091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.662109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.680581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8f5c-aa7e-4bc4-b67b-05de49afc453 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.689331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.690920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.691366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.691942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.692925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.694882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.726519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 857/1708] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:49:52.728509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 852/1709] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:52.730042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.730716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.731218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.731676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.756706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:52.760161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:52.774090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 853/1710] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:52.774666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08744f-88af-4d6e-b2e9-e630f4edd5e9 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.775946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.790206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd09260-2d54-4253-8d65-5fab396e5b93 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.791367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.793783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.793783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.795600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.795803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.796334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.796638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.796978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.797297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.799112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.803662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:49:52.804814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.809600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.834898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 858/1711] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:52.840707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 854/1712] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:49:52.841333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.841977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:52.868974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8299c-3b56-4387-8ce1-50ada9b4ae85 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.880640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.881710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.882366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.882716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.883437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:52.885897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:52.908843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a734bb2-6557-4ede-82a1-169f0e281f6a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:52.929945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 855/1713] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:52 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:52.931736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:52.932483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:52.932830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:52.933095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] PATH_INFO: `/v3/projects/c4c35259a1ed42a4bb760912cf208d5e/users/14917fcb939b4b77b56bd774fa477315/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:52.934678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.011780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c35259a1ed42a4bb760912cf208d5e, user_id=14917fcb939b4b77b56bd774fa477315, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.020182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d547-d6d9-4de1-b5c7-ca7394172c52 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.071849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 859/1714] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:52 2022] PUT /identity/v3/projects/c4c35259a1ed42a4bb760912cf208d5e/users/14917fcb939b4b77b56bd774fa477315/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:53.084756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.085081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.085315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.089413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cab6-d257-435b-bdbd-2c19823b7018 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.154255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] MFA Rules not processed for user `14917fcb939b4b77b56bd774fa477315`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:53.157958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:53.222835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:53.271466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.272191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.281364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.281630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.282252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.285464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.360683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 856/1715] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:52 2022] POST /identity/v3/users => generated 288 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:53.361710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.381332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2946b-bafc-4500-bb5e-c06bc6a8c2e5 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.392429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.392429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.392429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.392782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.393362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.395038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.415151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 857/1716] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:53.416366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.436990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04dec0-ccd9-439a-b091-b11f2ee493f0 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.445881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.446807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.447157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.447517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.448631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.450869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.458891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 860/1717] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:53 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:53.460111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.468497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 858/1718] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:53.473509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.487335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4b77-6dc2-4bfa-96a6-38b8b981f3cb admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.488863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:53.496049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.496863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.497331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.497883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] PATH_INFO: `/v3/projects/78afd87d717a45fca66b01cffd318f63/users/1e06ba5d799743ed8c9960c22c4501ee/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.520560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afd87d717a45fca66b01cffd318f63, user_id=1e06ba5d799743ed8c9960c22c4501ee, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.521210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2759f-d46d-4f8a-9fff-0c9a778721ec None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.525624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245130bc-2df2-4c8d-837d-3a17a2803610 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.544957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.550530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.550803 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.551085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.551801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.556458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 859/1719] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:53 2022] PUT /identity/v3/projects/78afd87d717a45fca66b01cffd318f63/users/1e06ba5d799743ed8c9960c22c4501ee/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:53.558399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.570930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.571307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.572127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.620645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] MFA Rules not processed for user `1e06ba5d799743ed8c9960c22c4501ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:53.622062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:53.652237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 861/1720] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:49:53 2022] POST /identity/v3/projects => generated 407 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:49:53.656060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.788084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 860/1721] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:49:53.805271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:53.806821 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:53.889348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49c37-f587-4323-bc92-39cbd68bf710 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.916595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:53.917382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:53.918156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:53.918852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:53.923944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:53.929403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:53.953723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b48e-abda-4cdc-aa0f-b3c3a5da79bd None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:53.974580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 862/1722] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:49:53 2022] POST /identity/v3/users => generated 310 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:49:53.982629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:54.022627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d033ba-4e7b-48eb-a905-9e668ff4a349 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:54.029056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.030094 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.030574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.031041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.031344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.032034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.032775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.035003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.035512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.040077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.049644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 863/1723] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:54.054372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:54.076719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e61e7-ba10-4d45-8a18-befa6f8d8793 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:54.085562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.086647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.087073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.087593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] PATH_INFO: `/v3/projects/6302f93d764d476b944080477da5137e/users/040674d61fc5438b888a3673c48f3e8b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.117276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6302f93d764d476b944080477da5137e, user_id=040674d61fc5438b888a3673c48f3e8b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.118105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:54.123104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.151973 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.153790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.174134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 864/1724] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:54 2022] PUT /identity/v3/projects/6302f93d764d476b944080477da5137e/users/040674d61fc5438b888a3673c48f3e8b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:49:54.176880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:54.180320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 861/1725] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:49:54.299175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:54.316336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ee847-2095-4e00-be46-c7c6660288d7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:54.324261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.325007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.325390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.325764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.326515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.329135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4cf6-a580-45f3-b4e6-8b15fb3b4873 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.352550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 865/1726] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:49:54.354160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:54.368350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8f53-d0b7-4644-9ea7-ce2bba8aa279 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:54.376800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.377946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.378298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.378676 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] PATH_INFO: `/v3/projects/6302f93d764d476b944080477da5137e/users/040674d61fc5438b888a3673c48f3e8b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.381112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6302f93d764d476b944080477da5137e, user_id=040674d61fc5438b888a3673c48f3e8b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.385396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.400554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 862/1727] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:49:54 2022] PUT /identity/v3/projects/6302f93d764d476b944080477da5137e/users/040674d61fc5438b888a3673c48f3e8b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:49:54.413046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.413365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.413994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.473203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] MFA Rules not processed for user `040674d61fc5438b888a3673c48f3e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:49:54.475028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:49:54.689864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 866/1728] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:49:54 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:49:54.705211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:54.852432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18038a9-0352-40cb-b7de-a707f39af6ad admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:54.860892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:54.861828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:54.862307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:54.862463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:54.882632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:54.887244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:54.904530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 863/1729] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:49:55.152478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:49:55.172311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41b821-972a-4a6c-abd0-0472b8659e5d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:49:55.178740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:49:55.179708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:49:55.180203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:49:55.180633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:49:55.263348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:49:55.264965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2974-742e-4c36-adcc-276c1780daa9 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:49:55.275168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 867/1730] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:00.011498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:00.016923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:00.313282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca705b4-9954-4948-8b8a-ac142ca44890 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:00.329805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:00.330510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:00.330792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:00.331066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] PATH_INFO: `/v3/users/238a120757434ba6bc5458e9593a23c7` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:00.338943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=238a120757434ba6bc5458e9593a23c7)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:00.347256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:00.463974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238a120757434ba6bc5458e9593a23c7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:00.473316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238a120757434ba6bc5458e9593a23c7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:00.474286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238a120757434ba6bc5458e9593a23c7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:00.474915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238a120757434ba6bc5458e9593a23c7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:00.490018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238a120757434ba6bc5458e9593a23c7'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:00.501637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:00.530250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 864/1731] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:00 2022] DELETE /identity/v3/users/238a120757434ba6bc5458e9593a23c7 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:00.536040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:00.536674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:00.537251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:00.586552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:00.589640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:00.700174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 868/1732] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:00.728544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:00.730274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:00.830927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44f2b-d618-4ab0-b8f9-6768cb442a5d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:00.834939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:00.835818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:00.836165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:00.836505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:00.859736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:00.861376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:00.874548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 865/1733] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:01.823514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:01.825145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:01.846714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a82be-19f0-4662-a013-1eaafff633cd None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:01.853689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:01.854937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:01.855621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:01.863419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] PATH_INFO: `/v3/users/14917fcb939b4b77b56bd774fa477315` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:01.863419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14917fcb939b4b77b56bd774fa477315)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:01.865298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:01.872559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:01.934252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:01.936851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:01.991773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f851-9287-4381-be29-1c6340554833 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:02.001683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14917fcb939b4b77b56bd774fa477315'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.007345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:02.007675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:02.008155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:02.008530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] PATH_INFO: `/v3/projects/b0bbf1031faa45beb36cf078f8a57b26` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:02.012464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0bbf1031faa45beb36cf078f8a57b26)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:02.014502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:02.020961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14917fcb939b4b77b56bd774fa477315'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.022342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14917fcb939b4b77b56bd774fa477315'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.025222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14917fcb939b4b77b56bd774fa477315'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.045515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5961a13b-eeeb-42c3-a71a-e7a62ceba44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14917fcb939b4b77b56bd774fa477315'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.117405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 869/1734] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:01 2022] DELETE /identity/v3/users/14917fcb939b4b77b56bd774fa477315 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:02.122266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:02.122572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:02.122809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:02.137837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0bbf1031faa45beb36cf078f8a57b26', 'request_id': 'req-c12bb24d-11f9-488a-add4-f03c12dddfb4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.151894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:02.153437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:02.156398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0bbf1031faa45beb36cf078f8a57b26', 'request_id': 'req-c12bb24d-11f9-488a-add4-f03c12dddfb4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.179422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0bbf1031faa45beb36cf078f8a57b26', 'request_id': 'req-c12bb24d-11f9-488a-add4-f03c12dddfb4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.219014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] The token cache is being invalidate because project b0bbf1031faa45beb36cf078f8a57b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:02.221902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.224464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.227272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 866/1735] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:01 2022] DELETE /identity/v3/projects/b0bbf1031faa45beb36cf078f8a57b26 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:02.234464 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:02.238395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:02.394220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 870/1736] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:02.401103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:02.407758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:02.458619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bb24d-11f9-488a-add4-f03c12dddfb4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:02.469949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:02.470885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:02.471489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:02.471941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] PATH_INFO: `/v3/users/017160bba82042ebb553e1c22447c614` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:02.473450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] RBAC: Authorizing `identity:delete_user(user_id=017160bba82042ebb553e1c22447c614)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:02.475852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:02.508728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:02.561525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5ad07-97fc-4a19-bc76-b1172f538e3a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:02.573202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:02.573795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:02.574087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:02.574453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:02.597323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:02.598256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017160bba82042ebb553e1c22447c614'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.599607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be89b-97c5-4624-865b-4cd1fe5fb174 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:02.615385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 871/1737] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:02.615666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017160bba82042ebb553e1c22447c614'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.616623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017160bba82042ebb553e1c22447c614'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.617557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017160bba82042ebb553e1c22447c614'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.630494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4e0d5f5e-8f42-4e21-b825-6483118e950a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017160bba82042ebb553e1c22447c614'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:02.669658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 867/1738] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:02 2022] DELETE /identity/v3/users/017160bba82042ebb553e1c22447c614 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:02.984907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:02.987697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:02.989401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:02.993746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 872/1739] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:50:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:50:03.017086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758558-8573-4887-a228-341f6b813d14 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.017907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758558-8573-4887-a228-341f6b813d14 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.017907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758558-8573-4887-a228-341f6b813d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.056423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8e758558-8573-4887-a228-341f6b813d14 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:03.059473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e758558-8573-4887-a228-341f6b813d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.109708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.112609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.182811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:03.242258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 868/1740] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:03.250772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758558-8573-4887-a228-341f6b813d14 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.257075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e758558-8573-4887-a228-341f6b813d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.275770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88f54-c5bc-49ca-b725-378a129fa917 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.282570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.283605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.284119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.284589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] PATH_INFO: `/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.286113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c690a9a8f31c49eeb0c7311ee990e53f)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.287234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758558-8573-4887-a228-341f6b813d14 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.290357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:03.296425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.297550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.298002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.298569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] PATH_INFO: `/v3/users/4fa389333d2a4ffe938dd78229d78ca8` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.300855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa389333d2a4ffe938dd78229d78ca8)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.306684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:03.398658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c690a9a8f31c49eeb0c7311ee990e53f', 'request_id': 'req-a184f28a-aa5b-42da-a44c-f650ea20c293'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.420012 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c690a9a8f31c49eeb0c7311ee990e53f', 'request_id': 'req-a184f28a-aa5b-42da-a44c-f650ea20c293'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.440612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa389333d2a4ffe938dd78229d78ca8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.450623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c690a9a8f31c49eeb0c7311ee990e53f', 'request_id': 'req-a184f28a-aa5b-42da-a44c-f650ea20c293'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.454154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa389333d2a4ffe938dd78229d78ca8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.455247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa389333d2a4ffe938dd78229d78ca8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.456309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa389333d2a4ffe938dd78229d78ca8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.467563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0fc7a759-339b-4e46-8420-a0ff1c6100a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa389333d2a4ffe938dd78229d78ca8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.472114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] The token cache is being invalidate because project c690a9a8f31c49eeb0c7311ee990e53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:03.472437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.473644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a184f28a-aa5b-42da-a44c-f650ea20c293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:03.475982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 873/1741] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:03 2022] DELETE /identity/v3/projects/c690a9a8f31c49eeb0c7311ee990e53f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:03.477456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadf8-cace-40bb-9aec-6c1a721e9ec5 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.477814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadf8-cace-40bb-9aec-6c1a721e9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.478359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadf8-cace-40bb-9aec-6c1a721e9ec5 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.481807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 874/1742] 10.222.0.33 () {54 vars in 961 bytes} [Sat Oct 15 13:50:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:50:03.485340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b82df-0489-4420-8853-abacc38c79d1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.485663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b82df-0489-4420-8853-abacc38c79d1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.486399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b82df-0489-4420-8853-abacc38c79d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.497771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:03.516622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 869/1743] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:03 2022] DELETE /identity/v3/users/4fa389333d2a4ffe938dd78229d78ca8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:03.518824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.519282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.520347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.525274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1f4b82df-0489-4420-8853-abacc38c79d1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:03.527073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1f4b82df-0489-4420-8853-abacc38c79d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.561599 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:03.563634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.647378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 875/1744] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:03.658384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.659333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.660272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.704501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:03.706906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.723414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 876/1745] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:03.728807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.749182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6582cf1-d600-43d4-95e6-63d1a424bda7 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.761830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.764345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.764634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.765041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.765805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:03.767093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.768068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:03.781887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 870/1746] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Oct 15 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:03.783549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.786103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.810438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 877/1747] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:03.810438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.813300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f27f2-50a9-48f1-b676-9b21d0f97fd3 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.822135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.823188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.823685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.824234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] PATH_INFO: `/v3/projects/c4c35259a1ed42a4bb760912cf208d5e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.826264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c35259a1ed42a4bb760912cf208d5e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.835554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:03.836818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978120-532c-43e8-b9ad-73758a791560 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.850377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.853384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.855210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.855889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.869502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:03.911397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.913229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:03.943268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 878/1748] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:03.945823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:03.965095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5642-412c-4a61-8524-521d2983f8c6 service placement] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:03.978312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:03.979019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:03.984646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:03.984646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:03.984646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:03.987820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.038737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c35259a1ed42a4bb760912cf208d5e', 'request_id': 'req-ad15bc2e-fbf5-4883-95dc-f353163e35c0'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.049518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:04.062628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 879/1749] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:03 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:04.062628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.065400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.074634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c35259a1ed42a4bb760912cf208d5e', 'request_id': 'req-ad15bc2e-fbf5-4883-95dc-f353163e35c0'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.084415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c35259a1ed42a4bb760912cf208d5e', 'request_id': 'req-ad15bc2e-fbf5-4883-95dc-f353163e35c0'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.097211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] The token cache is being invalidate because project c4c35259a1ed42a4bb760912cf208d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:04.097384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.098319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.101953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 871/1750] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:03 2022] DELETE /identity/v3/projects/c4c35259a1ed42a4bb760912cf208d5e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:04.103298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.105228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.214265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15bc2e-fbf5-4883-95dc-f353163e35c0 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.225841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.226540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.226871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.227194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.230004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.230463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.268951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932833-2d58-42b7-8a2a-f041e88c9e12 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.274653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 872/1751] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:04 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:04.275917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.278364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.282313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.283480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.284239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.284718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] PATH_INFO: `/v3/projects/cfebd22f91be42a7938ed6166cc8fb61` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.286961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfebd22f91be42a7938ed6166cc8fb61)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.291194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.293574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de351b-6ff8-4afb-86f4-afe60c1b36ff admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.301049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.302076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.302427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.302695 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] PATH_INFO: `/v3/users/040674d61fc5438b888a3673c48f3e8b` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.304313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040674d61fc5438b888a3673c48f3e8b)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.306939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.310388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:04.383060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfebd22f91be42a7938ed6166cc8fb61', 'request_id': 'req-875afcb4-d614-4c27-a751-3afd041c5d3a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.391496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfebd22f91be42a7938ed6166cc8fb61', 'request_id': 'req-875afcb4-d614-4c27-a751-3afd041c5d3a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.396843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040674d61fc5438b888a3673c48f3e8b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.406133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfebd22f91be42a7938ed6166cc8fb61', 'request_id': 'req-875afcb4-d614-4c27-a751-3afd041c5d3a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.414734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040674d61fc5438b888a3673c48f3e8b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.416047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040674d61fc5438b888a3673c48f3e8b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.417217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040674d61fc5438b888a3673c48f3e8b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.425447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] The token cache is being invalidate because project cfebd22f91be42a7938ed6166cc8fb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:04.426047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.427857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.431395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 880/1752] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:04 2022] DELETE /identity/v3/projects/cfebd22f91be42a7938ed6166cc8fb61 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:04.432562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-24b16039-1b28-427f-99ce-7ac3133a5bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040674d61fc5438b888a3673c48f3e8b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:04.434018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.438245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.464218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 873/1753] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:04 2022] DELETE /identity/v3/users/040674d61fc5438b888a3673c48f3e8b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:04.466009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae12e-db3f-465c-9690-03a55dd3f5a8 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.466611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae12e-db3f-465c-9690-03a55dd3f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.467916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae12e-db3f-465c-9690-03a55dd3f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.527143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c02ae12e-db3f-465c-9690-03a55dd3f5a8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:04.530518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c02ae12e-db3f-465c-9690-03a55dd3f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.601059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afcb4-d614-4c27-a751-3afd041c5d3a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.651813 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 874/1754] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:04.666330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.666901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.667467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.685255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:04.721543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:04.724296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.739960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 875/1755] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:04.747566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.764062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1861f-3fc7-4355-8d91-d8504000ca1f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.768169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.768904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.769184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.769609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.770139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.770950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.772051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.772781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.773635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.774261 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.776307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:04.776861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.781711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.787837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 881/1756] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:04.798602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.811462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a6d56-c867-43f1-950d-def8768cb645 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.817348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.818270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.818543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.818813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.819477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.824275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 876/1757] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:04.824484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.826798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.835839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 882/1758] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:04.838004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.846874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85991d3-c7d7-4228-8ae3-2433c7702f10 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.849719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54868-76b5-4560-8baf-0c0f845b706d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:04.855306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.856506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.856506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.856506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] PATH_INFO: `/v3/projects/1a30af1da5d348eba379f0fc3ea6d4af/users/9d30469f20d54d60b04c46f73a292708/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.856926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:04.857664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:04.858211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:04.858779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:04.860342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.865168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.894823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a30af1da5d348eba379f0fc3ea6d4af, user_id=9d30469f20d54d60b04c46f73a292708, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:04.897653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:04.919749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 883/1759] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:04 2022] PUT /identity/v3/projects/1a30af1da5d348eba379f0fc3ea6d4af/users/9d30469f20d54d60b04c46f73a292708/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:04.925461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 877/1760] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:04 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:04.933438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.933970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:04.935971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:04.990951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:05.018124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e5859-f608-41a4-b1a4-d484efb4ed98 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.024996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.025775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.026079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.026354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.031845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.031845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c448d6-1f5d-4c1c-90f1-3e24136f1f2b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.067890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 878/1761] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:04 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:05.067890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.067890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.067890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.079114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5f82-bbdd-4317-837d-9cfc6f639eb8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.088918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.090211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.090996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.091509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] PATH_INFO: `/v3/projects/6302f93d764d476b944080477da5137e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.093746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6302f93d764d476b944080477da5137e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.097398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.099894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] MFA Rules not processed for user `9d30469f20d54d60b04c46f73a292708`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:05.101165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.175894 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6302f93d764d476b944080477da5137e', 'request_id': 'req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:05.191865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 879/1762] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:05.191865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.192393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6302f93d764d476b944080477da5137e', 'request_id': 'req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:05.211371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccac0-9225-480c-9612-2d1e62648187 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.213212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6302f93d764d476b944080477da5137e', 'request_id': 'req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:05.233379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] The token cache is being invalidate because project 6302f93d764d476b944080477da5137e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:05.233681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:05.234394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:05.239413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 884/1763] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:04 2022] DELETE /identity/v3/projects/6302f93d764d476b944080477da5137e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:05.239413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.240689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.285067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:05.293166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.293899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.294231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.294505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.295305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.297596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843df22b-b780-444b-8bab-06ed5f9d366a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.330087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 880/1764] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:05.332067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.332662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.333121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.341740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c94a75-957c-4ce0-ac39-ef36ff4e78e1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.347024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.347675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.347991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.348267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.348996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.351189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.391672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 885/1765] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:05.392971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.393204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:05.395456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.398351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.479678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:05.508559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 881/1766] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:05.519964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.521047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5703698-8c66-4e9d-bb61-ffec1409b5af admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.531499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.532701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.533227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.533702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.534953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.536114 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4849d35-6297-4eb4-a3f7-38e8c79deb17 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.539214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbae4a9-a0f0-4023-ab7e-49a9ce879527 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.547249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.548784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.549134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.549703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.551007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.555870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.562722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 886/1767] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:05.565572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.566059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.566636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.604722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 882/1768] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:05.606466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.608730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:05.612212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.627517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400657b-448d-4de2-880a-32fdfc622869 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.629708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 887/1769] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:05.636236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.642664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.643736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.644140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.644510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] PATH_INFO: `/v3/projects/e06ed602bd6641798a2b557a322cf483/users/1f256bc704c4433ca6bf67dc0889783b/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.659079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49cfab-1cd5-43f3-a8c6-463ed7a0d4f1 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.679212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06ed602bd6641798a2b557a322cf483, user_id=1f256bc704c4433ca6bf67dc0889783b, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.684888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.690653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.692051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.692555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.693058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.694262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.698158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f44933-1f8b-4c28-9cf5-1b7c40d72176 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.715205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 883/1770] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:05 2022] PUT /identity/v3/projects/e06ed602bd6641798a2b557a322cf483/users/1f256bc704c4433ca6bf67dc0889783b/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:05.716503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.730060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 888/1771] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:05.732426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.732913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.733431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.772479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:05.774106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.807936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341f7f-5924-4cb7-a27d-1216c25f065f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.813910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.814671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.815334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.815334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.815946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:05.816257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.818288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.830933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 884/1772] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:05.831817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.843700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774f49-f006-416d-9f90-e0155f4225c7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.849139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.849844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.850126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:05.850403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] PATH_INFO: `/v3/projects/da67af8e65ae432e9a3b6abc5367d618/users/cb08bbc3971d46f686dca9469faec4f9/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:05.868459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67af8e65ae432e9a3b6abc5367d618, user_id=cb08bbc3971d46f686dca9469faec4f9, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:05.871312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:05.876350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 889/1773] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:05.879397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.894362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 885/1774] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:05 2022] PUT /identity/v3/projects/da67af8e65ae432e9a3b6abc5367d618/users/cb08bbc3971d46f686dca9469faec4f9/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:05.895337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:05.895495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3645-92cf-4e39-91b2-f911847771ae None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.900047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:05.953699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:05.986391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66866-90aa-487b-abdb-147db731be75 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:05.998520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:05.999462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:05.999757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.000078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.013033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.014084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.014506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.014954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.016002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.019674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.058870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:06.062763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 890/1775] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:05 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:06.064207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.101778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.104211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.121467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 886/1776] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:06.122854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.140538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931ebb-2d50-42cf-a72f-6a58f7bc0078 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.177949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f37f-2ac1-4836-bc40-bdae3cd0c1da admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.202439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.204262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.204849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.205390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.206768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.210046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.238303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 891/1777] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:06.246286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.253995 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.257837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.257837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.257837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.260321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.265930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8861c7-1077-4b5c-bd9e-03c7e6d51c38 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.267717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.274929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.276069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.276458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.276847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] PATH_INFO: `/v3/projects/da67af8e65ae432e9a3b6abc5367d618/users/cb08bbc3971d46f686dca9469faec4f9/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.279558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67af8e65ae432e9a3b6abc5367d618, user_id=cb08bbc3971d46f686dca9469faec4f9, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.284493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5b20-544a-40d9-ba2b-e4458dc0d087 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.304432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 887/1778] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:06 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:06.305499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 892/1779] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:06 2022] PUT /identity/v3/projects/da67af8e65ae432e9a3b6abc5367d618/users/cb08bbc3971d46f686dca9469faec4f9/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:06.308988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.320781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.321134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822092bb-61eb-404a-8672-4894c8632700 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.322435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.322973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.382622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] MFA Rules not processed for user `cb08bbc3971d46f686dca9469faec4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:06.385342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:06.464501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.465057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.465453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.466031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.466523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.468371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.482226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 888/1780] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:06.487960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.510413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f03dc-6a13-413a-bb6d-afd831172b35 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.520165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.522675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.523200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.523864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.528677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 893/1781] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:06.541023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.543051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.552280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.553865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:06.568864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 889/1782] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:06.571771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.589476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6040-7969-416b-b491-a7479f36e748 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.598533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.598899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:06.599722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.600498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.601068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] PATH_INFO: `/v3/projects/c2ea7752539f488883589e540552a255/users/8d0f0a46aacf4363a1a041895f2faeb7/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.634267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ea7752539f488883589e540552a255, user_id=8d0f0a46aacf4363a1a041895f2faeb7, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.638946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b90f0-6ee6-46b9-a35e-0cf4c92d7ba9 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:06.648122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:06.648122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.648122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.648122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.650649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:06.664866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263eb8-be2c-4214-a6ec-4e727586b9c7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.683690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 890/1783] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:06 2022] PUT /identity/v3/projects/c2ea7752539f488883589e540552a255/users/8d0f0a46aacf4363a1a041895f2faeb7/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:06.696536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:06.696835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:06.697042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:06.731859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] MFA Rules not processed for user `8d0f0a46aacf4363a1a041895f2faeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:06.733182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:06.762333 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:06.778688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:06.783193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:06.804728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 894/1784] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:06.878472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 891/1785] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:06.879250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:06.896530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d939df-079a-4e16-8329-f33911ad92ac service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.070126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.072274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.072785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.073490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.074943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.081186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d54826-a415-4c1d-8e91-22f3eb5decf0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.157872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 895/1786] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:06 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:07.159276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.177872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f277b9d-4144-4479-b7db-3a9870451ee0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.257750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.258939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.258939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.309044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] MFA Rules not processed for user `1f256bc704c4433ca6bf67dc0889783b`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:07.310505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:07.331042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.331822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.333444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.333827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.334790 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.339893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.409551 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 892/1787] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:07 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:07.410532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.436192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8124f38-9838-47d6-9d15-0fe410afd1cc admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.445406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.446507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.448387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.448387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.450294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.454351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.466115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:07.488404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 896/1788] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:07.495334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 893/1789] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:07.498507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.502127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.537135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63c15-8a52-4caf-8764-0f6beb40b289 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.538692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9a649-70a1-40e7-99f3-be546060d72c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.545850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.546844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.547037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.547544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.547895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.548289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] PATH_INFO: `/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0/users/cdfa75cfb00f48fb805885479f819146/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.548479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.549077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.550281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.554834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.579203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0096cfe4bf0142a791d303b3cbbd56b0, user_id=cdfa75cfb00f48fb805885479f819146, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.586119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.611097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 894/1790] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:07 2022] PUT /identity/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0/users/cdfa75cfb00f48fb805885479f819146/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:07.616959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.629181 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 897/1791] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:07 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:07.636056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.732439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57791843-ca4c-45c1-a6d7-0350f0c19dd1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.753485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:07.759684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34db6a-38de-46de-842f-f87f6407357b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.765365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.766162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.766541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.766835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.767505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.769763 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.799133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 898/1792] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:07 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:07.805831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.822504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e70d0-2f51-4a30-8043-e9270b2ea10c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.832962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.833946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.834344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.834705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.835901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.838072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.845725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.846371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.846656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.846922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.847570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.849244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.850469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 899/1793] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:07.856517 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.861776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 895/1794] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:07.866504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.872935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9641c-1e91-4a9a-af38-8b376fb7e463 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.880708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.881761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.882278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.882733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] PATH_INFO: `/v3/projects/cf6f833da3e949e99fe846198c49edf8/users/daa47534eccf4d7f8f192f61a9bf0050/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.884629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc940-6a12-4184-b38b-6981e5d3a3e2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:07.891653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:07.892751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.893178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.893615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] PATH_INFO: `/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0/users/cdfa75cfb00f48fb805885479f819146/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.896881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0096cfe4bf0142a791d303b3cbbd56b0, user_id=cdfa75cfb00f48fb805885479f819146, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.901602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8b46-36a0-46b6-a4c4-acc008968d44 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.909786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6f833da3e949e99fe846198c49edf8, user_id=daa47534eccf4d7f8f192f61a9bf0050, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:07.914959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:07.919774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 896/1795] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:07 2022] PUT /identity/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0/users/cdfa75cfb00f48fb805885479f819146/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:07.932243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:07.932521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:07.932787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:07.942371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 900/1796] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:07 2022] PUT /identity/v3/projects/cf6f833da3e949e99fe846198c49edf8/users/daa47534eccf4d7f8f192f61a9bf0050/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:07.946593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:07.982526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] MFA Rules not processed for user `cdfa75cfb00f48fb805885479f819146`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:07.983834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.032922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c28eb-33d9-4b4b-93a1-08ead85f78f2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.038682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.039326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.039635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.039989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.040665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.042407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.055472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 901/1797] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:08.059542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:08.067507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 897/1798] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:08.073913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278971-c686-4767-9fdf-9621626660b7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.080622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:08.082293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.082993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.083277 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.083554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] PATH_INFO: `/v3/projects/cf6f833da3e949e99fe846198c49edf8/users/daa47534eccf4d7f8f192f61a9bf0050/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.085887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6f833da3e949e99fe846198c49edf8, user_id=daa47534eccf4d7f8f192f61a9bf0050, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.089982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.107962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 902/1799] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:08 2022] PUT /identity/v3/projects/cf6f833da3e949e99fe846198c49edf8/users/daa47534eccf4d7f8f192f61a9bf0050/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:08.160102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857edf4-3a2a-4dd0-acc4-b22cb161fa14 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.217557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:08.219044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:08.221375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.236559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.237358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.237650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.237959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.241205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:08.344501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c01b6-81c1-4d53-8c74-873f4e4d817f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.349239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.351101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef7aca-511b-40b4-94ed-45e56c356a81 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.352886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.354134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.354545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.355186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] PATH_INFO: `/v3/users/1e06ba5d799743ed8c9960c22c4501ee` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.357495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e06ba5d799743ed8c9960c22c4501ee)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.360289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.366397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 898/1800] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:08.481119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e06ba5d799743ed8c9960c22c4501ee'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:08.508045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e06ba5d799743ed8c9960c22c4501ee'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:08.509039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e06ba5d799743ed8c9960c22c4501ee'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:08.509768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e06ba5d799743ed8c9960c22c4501ee'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:08.520559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e06ba5d799743ed8c9960c22c4501ee'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:08.552599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 903/1801] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:08 2022] DELETE /identity/v3/users/1e06ba5d799743ed8c9960c22c4501ee => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:08.563197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.563479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.563761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.588599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:08.590051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.604530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:08.605752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.704873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16616b9-b77e-4c45-a130-f66b6f0a322a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.711117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.712305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.712913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.713412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.717892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.723379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 899/1802] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:08.741755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:08.744139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:08.785250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:08.818578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.819997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ca4b-8e26-4521-87da-f24632e7258c service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.833226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 904/1803] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:08.862161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8fa7b-35b8-4085-b086-c6eae2a42480 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:08.874740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:08.877117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:08.881519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:08.882391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:08.905901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:08.907422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:08.922323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 900/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:09.277550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.277999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.278269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.346697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] MFA Rules not processed for user `daa47534eccf4d7f8f192f61a9bf0050`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:09.348387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.376492 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.378250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.402624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113f23-e1eb-4465-95d0-b21f4be9e42f service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:09.416617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:09.417289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.417564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.418007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] PATH_INFO: `/v3/projects/78afd87d717a45fca66b01cffd318f63` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.419398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78afd87d717a45fca66b01cffd318f63)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:09.421672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:09.467986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 905/1805] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:09.473740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.475858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.480725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:09.498148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd008-fc69-4e57-b9d4-3cba4a7da94f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:09.515079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78afd87d717a45fca66b01cffd318f63', 'request_id': 'req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.530659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78afd87d717a45fca66b01cffd318f63', 'request_id': 'req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.543038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78afd87d717a45fca66b01cffd318f63', 'request_id': 'req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.580251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] The token cache is being invalidate because project 78afd87d717a45fca66b01cffd318f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:09.580636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.581375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-59f436ad-cec2-43a6-92f6-48a6ad0d8e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.586655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 901/1806] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:09 2022] DELETE /identity/v3/projects/78afd87d717a45fca66b01cffd318f63 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:09.588320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dfea-6b0b-4050-8de8-a29fb806d547 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.588600 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dfea-6b0b-4050-8de8-a29fb806d547 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.588884 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dfea-6b0b-4050-8de8-a29fb806d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.609802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b734dfea-6b0b-4050-8de8-a29fb806d547 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:09.611036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b734dfea-6b0b-4050-8de8-a29fb806d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.646986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:09.647836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.648211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.648742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] PATH_INFO: `/v3/users/8d0f0a46aacf4363a1a041895f2faeb7` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.652179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0f0a46aacf4363a1a041895f2faeb7)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:09.656680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:09.688930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 902/1807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:09.697240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.697749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.698024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.725928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:09.727771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.733388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0f0a46aacf4363a1a041895f2faeb7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.737598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 903/1808] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:09.742133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.745758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0f0a46aacf4363a1a041895f2faeb7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.746863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0f0a46aacf4363a1a041895f2faeb7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.748289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0f0a46aacf4363a1a041895f2faeb7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.752093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242f13b-fea6-4454-b16e-4d9c7d52453e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:09.759457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:09.760145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.760425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.760696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.764449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:09.764791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:09.766693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:09.776780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cff63777-2a84-466c-9628-ff4d665b024b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0f0a46aacf4363a1a041895f2faeb7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:09.784345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:09.786911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 904/1809] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:50:09.787971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.790179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.816779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c2059-384f-4d44-97c5-1de87ed70da1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:09.822765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 906/1810] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:09 2022] DELETE /identity/v3/users/8d0f0a46aacf4363a1a041895f2faeb7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:09.827937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:09.828570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.828896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.829120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.829400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.829666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.832715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.833388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:09.835349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:09.852337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:09.854250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.871361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 905/1811] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:09.871875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.923171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 907/1812] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:09.934589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:09.935748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:09.947126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d018-7ee0-4a15-8fa0-b18b2bb59940 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:09.952541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:09.953160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:09.953439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:09.953712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:09.954347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:09.957251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:09.990493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 906/1813] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:09 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:09.993708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.002110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:10.007593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f78b5-6672-4ee9-8475-aa872a81c5db admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.009029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a296-d2c4-4cae-a461-1885e770e4d6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.017833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.018824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.019640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.020569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.021769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.024299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.037771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 907/1814] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:10.042068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.062610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a0c-28fc-4673-ae6f-cdb2d34203c4 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.075607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.076892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.077674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.078166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.078554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.078978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.079358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.079699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.080582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.084501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0813ed0-ffbf-4b04-85ff-ed658e92ab1d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.094671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.098052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.111280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 908/1815] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:10.117120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 908/1816] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:10.121402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.132167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeec645-acc1-499f-81f1-8ffe74a269b9 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.138998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.139678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.140005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.140307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] PATH_INFO: `/v3/projects/1a78e681ca38422d98e8aff2c7b4ff51/users/1e0cd522aa294533b69dca16bfa79077/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.161612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a78e681ca38422d98e8aff2c7b4ff51, user_id=1e0cd522aa294533b69dca16bfa79077, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.166295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.190378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 909/1817] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:10 2022] PUT /identity/v3/projects/1a78e681ca38422d98e8aff2c7b4ff51/users/1e0cd522aa294533b69dca16bfa79077/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:10.204810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.205106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.205330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.253897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] MFA Rules not processed for user `1e0cd522aa294533b69dca16bfa79077`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:10.255410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:10.372703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 909/1818] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:10.377615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.403288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:10.513579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddcaa-7b81-49f5-8f30-2847104bb298 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.527575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.529390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.530866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.530866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.532496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.538609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.607699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 910/1819] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:10 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:10.612615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.624744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbebfa0-a829-48a5-b4d5-2d7360df143a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.731389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.732149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.732320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.732594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.733327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.735284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.737210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.739527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:10.758015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df72179-17b6-4fe4-b1d7-351b15e43bc7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.760760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 910/1820] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:10 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:10.764585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.767809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.768492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.768771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.769045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] PATH_INFO: `/v3/projects/c2ea7752539f488883589e540552a255` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.770945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ea7752539f488883589e540552a255)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.773473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.777372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60290fe-16e1-4688-852d-aca381cc7948 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.782734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.783365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.783642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.783950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.784601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.786349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.813537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 911/1821] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:10.817581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.828881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d9e0-b638-4690-b6de-762a732b0bff admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.852587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ea7752539f488883589e540552a255', 'request_id': 'req-c436dc6a-d967-4d03-a321-a0d3a2a794b7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:10.866896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ea7752539f488883589e540552a255', 'request_id': 'req-c436dc6a-d967-4d03-a321-a0d3a2a794b7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:10.882249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ea7752539f488883589e540552a255', 'request_id': 'req-c436dc6a-d967-4d03-a321-a0d3a2a794b7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:10.893765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:10.904217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] The token cache is being invalidate because project c2ea7752539f488883589e540552a255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:10.904499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:10.905260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:10.907683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 911/1822] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:10 2022] DELETE /identity/v3/projects/c2ea7752539f488883589e540552a255 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:10.911308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.912537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.912766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.913125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.914447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.914875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:10.917197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.920565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.931546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dc6a-d967-4d03-a321-a0d3a2a794b7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.937317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.938311 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.938737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.939158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] PATH_INFO: `/v3/users/cdfa75cfb00f48fb805885479f819146` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:10.940734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfa75cfb00f48fb805885479f819146)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:10.942869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:10.949334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 912/1823] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:10.951258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:10.953183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:10.967223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ec32-c840-4c04-aadd-dc5c73b19a1e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:10.975388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:10.976528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:10.976808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:10.977110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] PATH_INFO: `/v3/projects/5ce2fd0e1d08408a99e9752e0c6c1174/users/e49cec80c169445ea2c8a14657786c96/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.007023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce2fd0e1d08408a99e9752e0c6c1174, user_id=e49cec80c169445ea2c8a14657786c96, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.011355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.031869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfa75cfb00f48fb805885479f819146'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.049173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 913/1824] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:10 2022] PUT /identity/v3/projects/5ce2fd0e1d08408a99e9752e0c6c1174/users/e49cec80c169445ea2c8a14657786c96/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:11.049173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.049472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfa75cfb00f48fb805885479f819146'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.049472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfa75cfb00f48fb805885479f819146'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.049663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.049747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfa75cfb00f48fb805885479f819146'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.059678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0d2a0035-f925-4825-8609-f5cd0b0b4a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfa75cfb00f48fb805885479f819146'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.082213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.091354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 912/1825] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:10 2022] DELETE /identity/v3/users/cdfa75cfb00f48fb805885479f819146 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:11.093007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.093265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.093706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.136704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] MFA Rules not processed for user `e49cec80c169445ea2c8a14657786c96`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:11.138148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.188196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9625e6-535f-43bf-abe0-87a0c27345e6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.219429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 913/1826] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:11.224087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.226159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.264382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.265446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.265730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.266022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] PATH_INFO: `/v3/users/1f256bc704c4433ca6bf67dc0889783b` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.267577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f256bc704c4433ca6bf67dc0889783b)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.270206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.312071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b4af-d0da-4ea2-9b2e-ff6edcbf1d3a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.317941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.318784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.319122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.319463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.320327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.322577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.339339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f256bc704c4433ca6bf67dc0889783b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.353177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f256bc704c4433ca6bf67dc0889783b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.354003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f256bc704c4433ca6bf67dc0889783b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.355033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f256bc704c4433ca6bf67dc0889783b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.355529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 914/1827] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:11 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:11.359480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.361765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.370004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f256bc704c4433ca6bf67dc0889783b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.380864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.400150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 914/1828] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:11 2022] DELETE /identity/v3/users/1f256bc704c4433ca6bf67dc0889783b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:11.422609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.424232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.445340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2115b89-48e6-43c0-a08b-29c234940978 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.472265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.513170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cec1-bba4-4899-98a7-0d592bc36a30 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.518100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.518846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.519101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.519266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.519564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] PATH_INFO: `/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.519728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.520052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.520328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.520959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0096cfe4bf0142a791d303b3cbbd56b0)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.521065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.522922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.523027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.554778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 915/1829] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:11 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:11.559345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.573418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176bfb2-0419-4021-b028-089c25e94c2d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.581938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0096cfe4bf0142a791d303b3cbbd56b0', 'request_id': 'req-13181585-c8a2-4e9c-a680-47c399834d9d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.595478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0096cfe4bf0142a791d303b3cbbd56b0', 'request_id': 'req-13181585-c8a2-4e9c-a680-47c399834d9d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.608401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0096cfe4bf0142a791d303b3cbbd56b0', 'request_id': 'req-13181585-c8a2-4e9c-a680-47c399834d9d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.627083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] The token cache is being invalidate because project 0096cfe4bf0142a791d303b3cbbd56b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:11.627817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.628438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.630016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 915/1830] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:11 2022] DELETE /identity/v3/projects/0096cfe4bf0142a791d303b3cbbd56b0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:11.630929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.635626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.656934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.658448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.658448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.658448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.659144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.663958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a391-44bf-4d8d-b2e1-6529aa6d1cd4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.684942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 916/1831] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:11.684942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.684942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.685870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.714865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:11.716945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.726997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 917/1832] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:11.728545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.730243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.746993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c2cf-2ca2-439e-9ae0-fc6ebb39d7d8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.753460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.754480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.754959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.755127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] PATH_INFO: `/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce/users/a07707f44f1c4c91821fe27629825944/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.777407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98849e40e7934a7bb86c9fa1e03bf3ce, user_id=a07707f44f1c4c91821fe27629825944, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.780469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca7ba-47cf-4a56-853b-cbaaaf946f7b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.791981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181585-c8a2-4e9c-a680-47c399834d9d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.803549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 918/1833] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:11 2022] PUT /identity/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce/users/a07707f44f1c4c91821fe27629825944/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:11.804906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.805215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.805516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.829126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.839656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:11.843999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:11.897172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.898664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.898999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.899460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] PATH_INFO: `/v3/projects/e06ed602bd6641798a2b557a322cf483` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.900647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06ed602bd6641798a2b557a322cf483)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.902817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.912900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 919/1834] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:11.912900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.922706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd2b60-272a-4779-b4d4-4a965b57326c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.928170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:11.929233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:11.929515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:11.929784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:11.930655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:11.932319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:11.947778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 920/1835] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:11.948712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:11.960250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d177e30-2ad7-4959-936d-93cef36420d0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:11.966725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.973320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06ed602bd6641798a2b557a322cf483', 'request_id': 'req-16271aba-2258-4463-bc10-72fc070ffe45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.982315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06ed602bd6641798a2b557a322cf483', 'request_id': 'req-16271aba-2258-4463-bc10-72fc070ffe45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:11.990364 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06ed602bd6641798a2b557a322cf483', 'request_id': 'req-16271aba-2258-4463-bc10-72fc070ffe45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.002858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] The token cache is being invalidate because project e06ed602bd6641798a2b557a322cf483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:12.003391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.004136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.005997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 916/1836] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:11 2022] DELETE /identity/v3/projects/e06ed602bd6641798a2b557a322cf483 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:12.006872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.008274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.028305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.028944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.029478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.029478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.030130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:12.030580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.032209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.047821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 921/1837] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:12.047821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.047821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.061742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9040319-6829-4d71-abf3-8482c90a5e77 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.076782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.077463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.077846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.078192 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] PATH_INFO: `/v3/users/daa47534eccf4d7f8f192f61a9bf0050` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.079455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa47534eccf4d7f8f192f61a9bf0050)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.081401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.087522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271aba-2258-4463-bc10-72fc070ffe45 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.092468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.093183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.093506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.093778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] PATH_INFO: `/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce/users/a07707f44f1c4c91821fe27629825944/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.095926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=98849e40e7934a7bb86c9fa1e03bf3ce, user_id=a07707f44f1c4c91821fe27629825944, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.098718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.111947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 917/1838] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:12 2022] PUT /identity/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce/users/a07707f44f1c4c91821fe27629825944/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:12.113032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.114810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.153360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa47534eccf4d7f8f192f61a9bf0050'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.167041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa47534eccf4d7f8f192f61a9bf0050'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.168565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa47534eccf4d7f8f192f61a9bf0050'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.169180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa47534eccf4d7f8f192f61a9bf0050'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.181896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9b5823e8-1263-40a9-99b3-0717bce9c060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa47534eccf4d7f8f192f61a9bf0050'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.201925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:12.208006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 922/1839] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:12 2022] DELETE /identity/v3/users/daa47534eccf4d7f8f192f61a9bf0050 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:12.215309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.215599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.218013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.223323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d882b8-883d-4d7d-b845-815c9c4fc4aa admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.252893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] MFA Rules not processed for user `a07707f44f1c4c91821fe27629825944`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:12.254127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.307105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.307833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.308119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.308320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.308969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.310931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.358883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:12.363504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 918/1840] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:12.367774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.372639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.382522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 923/1841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:12.389889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.391414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.454459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31244-ad41-4426-9681-1235b9cf6ff2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.460519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.461595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.462288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.463308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.464390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.466560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.483230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd752d-b325-483f-9e3f-45a5f08e64a6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.499843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 919/1842] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:12.502276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.514192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99140b16-9f41-4282-a7f8-993d715c9ccf admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.520430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.521429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.522003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.522552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.523479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.525869 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.539925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 920/1843] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:12.541026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.544648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.560968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa35f-1ff7-4348-b55a-07dbf746dc5b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.563654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.564495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.565109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.565109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.567299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.568177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.568680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.568867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] PATH_INFO: `/v3/projects/cf6f833da3e949e99fe846198c49edf8` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.570506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6f833da3e949e99fe846198c49edf8)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.573707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.574526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.629420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6f833da3e949e99fe846198c49edf8', 'request_id': 'req-0d04e04d-5887-4fc9-b509-0523a8594015'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.639103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6f833da3e949e99fe846198c49edf8', 'request_id': 'req-0d04e04d-5887-4fc9-b509-0523a8594015'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.640894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:12.641155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.642852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.650879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6f833da3e949e99fe846198c49edf8', 'request_id': 'req-0d04e04d-5887-4fc9-b509-0523a8594015'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.654285 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 924/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:12.657122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.663525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] The token cache is being invalidate because project cf6f833da3e949e99fe846198c49edf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:12.663990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.664752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0d04e04d-5887-4fc9-b509-0523a8594015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:12.666857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 921/1845] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:12 2022] DELETE /identity/v3/projects/cf6f833da3e949e99fe846198c49edf8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:12.670166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343bf9-4f19-4d4b-accb-e7011f0d60f5 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.671388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de53a-fe4f-4f61-b2e6-48f08745879c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.671673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de53a-fe4f-4f61-b2e6-48f08745879c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.671980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de53a-fe4f-4f61-b2e6-48f08745879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.699104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e70de53a-fe4f-4f61-b2e6-48f08745879c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:12.700460 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e70de53a-fe4f-4f61-b2e6-48f08745879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.748742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.749551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.749899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.750232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.750972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.752699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.766567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 925/1846] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:12.772858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.777777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.784656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 922/1847] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:12.793596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.794246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.794246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.799142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:12.808187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385ed49-d397-42aa-9660-af1efc463b89 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.816249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:12.817194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.817623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.817983 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] PATH_INFO: `/v3/projects/2b66288166da45e8abf82fabd0ed19a9/users/83483d0c21604057910a6a27eb681b89/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.837210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:12.838985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.839687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b66288166da45e8abf82fabd0ed19a9, user_id=83483d0c21604057910a6a27eb681b89, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:12.842431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc005de-8f9a-4039-ba30-7470956adace admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:12.849699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 923/1848] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:12.855719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:12.863564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 926/1849] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:12 2022] PUT /identity/v3/projects/2b66288166da45e8abf82fabd0ed19a9/users/83483d0c21604057910a6a27eb681b89/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:12.871412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:12.872126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:12.872409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:12.874193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422a77-86bf-4ccf-b81c-8f6cc4cdb0b6 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:12.897735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:12.899253 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:12.979291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 927/1850] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:13.012156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.013676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.040757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.042224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.042941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.043655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.045138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:13.046932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.050361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.090235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 924/1851] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:50:13.096001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.114420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a511-d1d4-48a5-8170-be3dd518c4c3 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.122094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.123533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.124075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.124522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.125563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.128974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.134246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4886b-990a-4812-87bc-086b7be157c4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.138671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.139451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.140558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.140898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.166559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.168820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.173167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 925/1852] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:13.179248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.201177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 928/1853] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:13.204847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.206360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.223367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a7114-5971-48a9-9cc2-fae4d4c7edcc service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.254251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:13.288865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82262-8fe4-49e9-89bf-4097a57f2b17 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.295253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.295949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.296203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.296528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.297186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.299991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.342808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 926/1854] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:13.345133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.348917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.350004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.350471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.350946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] PATH_INFO: `/v3/users/9d30469f20d54d60b04c46f73a292708` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.361926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d30469f20d54d60b04c46f73a292708)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.366464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.379658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa86d3-fd01-4fc8-9e28-7bc1bc4f5019 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.386196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.387269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.387641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.387996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.388719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.391272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.404146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 927/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:13.405245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:13.408804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.422019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad48e-fb5a-4ec8-ba3d-0f8cb3951570 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.429931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.430689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.430957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.431613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.432350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.435017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.454985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 928/1856] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:13.456744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.459163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d30469f20d54d60b04c46f73a292708'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:13.470440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b70a-014f-41d6-95f9-81ac981ce23b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.474415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d30469f20d54d60b04c46f73a292708'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:13.475437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d30469f20d54d60b04c46f73a292708'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:13.476496 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d30469f20d54d60b04c46f73a292708'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:13.479251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.480495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.480911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.481315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] PATH_INFO: `/v3/projects/8f080f4f55fe4622a626a510c0fd5805/users/ad08ec1b0e1e4b2ab536a9d7a60a4141/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.488531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-634bcd61-ee76-4e42-a32c-f95338626753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d30469f20d54d60b04c46f73a292708'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:13.503612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f080f4f55fe4622a626a510c0fd5805, user_id=ad08ec1b0e1e4b2ab536a9d7a60a4141, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.506732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc5d8-c02f-4ca4-bcea-59c7efbe9206 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.517231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 929/1857] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:13 2022] DELETE /identity/v3/users/9d30469f20d54d60b04c46f73a292708 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:13.522208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.523129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.523546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.527931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 929/1858] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:13 2022] PUT /identity/v3/projects/8f080f4f55fe4622a626a510c0fd5805/users/ad08ec1b0e1e4b2ab536a9d7a60a4141/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:13.539117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.539395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.539856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.555249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:13.558358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.572312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] MFA Rules not processed for user `ad08ec1b0e1e4b2ab536a9d7a60a4141`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:13.573751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.651081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 930/1859] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:13.655635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 930/1860] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:13.660378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.661961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.665591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.667453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:13.675974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b5e58-eca7-42d1-bb95-d2afcdb893d0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.681784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.682486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.682882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.683162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.683780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.685755 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.732375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 931/1861] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:13.737891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.772012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913efd6b-8466-4e3b-9871-e5dd1006f76a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.817134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d2f-13f8-4297-8b92-5aaca899ea4e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.828053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.828969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.829312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.829648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.830360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.832552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.832975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:13.854039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.855990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.856408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.856783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.860039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 932/1862] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:13 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:13.864046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.869402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.871437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.876372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046e40e-5ec5-44c1-b0d3-56aab04417e8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.881792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.882464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.882862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.883010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.883772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.885471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 931/1863] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:13.885627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.891339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:13.897220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 933/1864] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:13.901282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.911382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82689c-daef-4bd0-8138-73652b2ff738 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:13.916230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:13.916921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:13.917202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:13.917473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] PATH_INFO: `/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86/users/ad7d49fea9254ecc9d93483cddd91fa6/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:13.937245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d77c23d39d348c5bf51f9ae8f869f86, user_id=ad7d49fea9254ecc9d93483cddd91fa6, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:13.939913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:13.956761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 932/1865] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:13 2022] PUT /identity/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86/users/ad7d49fea9254ecc9d93483cddd91fa6/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:13.960982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:13.972066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c21c-4db6-4df0-a38c-5fc5893d4816 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.037733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.038441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.038756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.039039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.039837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:14.041467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1669b5-db10-45ba-99b0-b5912a482624 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:14.055368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 934/1866] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:14.060062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.071565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722b6a6-ca31-4b80-95e0-6c87b4799e9f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.078280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.079236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.079518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.080238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] PATH_INFO: `/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86/users/ad7d49fea9254ecc9d93483cddd91fa6/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.082091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d77c23d39d348c5bf51f9ae8f869f86, user_id=ad7d49fea9254ecc9d93483cddd91fa6, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:14.084900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:14.096875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 933/1867] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:14 2022] PUT /identity/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86/users/ad7d49fea9254ecc9d93483cddd91fa6/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:14.111163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b47-2b04-48d6-ae54-8e8ea756e95a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.111163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b47-2b04-48d6-ae54-8e8ea756e95a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.111163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b47-2b04-48d6-ae54-8e8ea756e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.147055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-4b664b47-2b04-48d6-ae54-8e8ea756e95a None None] MFA Rules not processed for user `ad7d49fea9254ecc9d93483cddd91fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:14.151617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4b664b47-2b04-48d6-ae54-8e8ea756e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.239420 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 935/1868] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:14.255690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.258035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.395391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a5ce-719d-4f9c-846c-a4adc692caaf admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.400086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.400998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.401442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.401910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.416812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:14.419245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:14.446382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.446825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.447198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.448724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 934/1869] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:14.481450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.483403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.499020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] MFA Rules not processed for user `83483d0c21604057910a6a27eb681b89`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:14.500711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.642562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8d22-114c-41c5-974e-630de673556b service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.647354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.648247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.648527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.648827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] PATH_INFO: `/v3/projects/1a30af1da5d348eba379f0fc3ea6d4af` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.650224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a30af1da5d348eba379f0fc3ea6d4af)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:14.652212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:14.664323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 936/1870] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:14.668841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.671275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.701438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde105d-be94-47ae-9f7f-23dd4975d23d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.707905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.716899 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.717203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.717391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.722629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:14.725074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:14.746109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:14.766641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a30af1da5d348eba379f0fc3ea6d4af', 'request_id': 'req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:14.771019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 937/1871] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:14 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:14.773069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:14.776823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.813386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a30af1da5d348eba379f0fc3ea6d4af', 'request_id': 'req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:14.832483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a30af1da5d348eba379f0fc3ea6d4af', 'request_id': 'req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:14.849593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] The token cache is being invalidate because project 1a30af1da5d348eba379f0fc3ea6d4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:14.849593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:14.850188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:14.852295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 935/1872] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:14 2022] DELETE /identity/v3/projects/1a30af1da5d348eba379f0fc3ea6d4af => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:14.853544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:14.858838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.893851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9851-efb9-4e69-bc64-d8593e6ba61d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:14.900382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:14.901388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:14.901935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:14.902414 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:14.904909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:14.991112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a5ae-c9f2-4c68-ad9c-80ecfa0ab81e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.015524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.017033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.032597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 938/1873] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:15.033469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.035408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:15.124699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.125332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.125607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.125881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.126513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.128875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.145476 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dbfb9-5064-4f33-aeae-b2118680d4d5 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.152754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.154388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.154694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.155256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] PATH_INFO: `/v3/users/cb08bbc3971d46f686dca9469faec4f9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.158208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb08bbc3971d46f686dca9469faec4f9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.161749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.176975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 936/1874] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:14 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:15.181521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.217944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de6c7-8cea-487e-b91d-f5cd6fc943b5 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.232750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.233340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.233645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.233885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.234544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.236853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.244531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:15.249355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb08bbc3971d46f686dca9469faec4f9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:15.257778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 937/1875] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:15.259134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.265970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb08bbc3971d46f686dca9469faec4f9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:15.266821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb08bbc3971d46f686dca9469faec4f9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:15.267859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb08bbc3971d46f686dca9469faec4f9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:15.289598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cd4d-09bf-4d3c-842f-21b192d0454d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.289850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb08bbc3971d46f686dca9469faec4f9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:15.298851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.299554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.299930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.300204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] PATH_INFO: `/v3/projects/c1b18bf103ca4f349410f974d727f54e/users/4e4f951732734f05a666f98ce162dcc6/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.326796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 939/1876] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:15 2022] DELETE /identity/v3/users/cb08bbc3971d46f686dca9469faec4f9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:15.336143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b18bf103ca4f349410f974d727f54e, user_id=4e4f951732734f05a666f98ce162dcc6, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.339521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.363214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.364181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 938/1877] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:15 2022] PUT /identity/v3/projects/c1b18bf103ca4f349410f974d727f54e/users/4e4f951732734f05a666f98ce162dcc6/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:15.365290 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:15.460212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7776-9e91-4e1b-97a7-5a3301676ce3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.544867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.545569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.545817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.546034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.546696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.548489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.580779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 940/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:15.585027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.598615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564542-4a4f-4f45-b7b9-8ca6888af934 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.610459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.612879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.614073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.614458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] PATH_INFO: `/v3/projects/c1b18bf103ca4f349410f974d727f54e/users/4e4f951732734f05a666f98ce162dcc6/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.618546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b18bf103ca4f349410f974d727f54e, user_id=4e4f951732734f05a666f98ce162dcc6, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.623546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.638312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 939/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:15 2022] PUT /identity/v3/projects/c1b18bf103ca4f349410f974d727f54e/users/4e4f951732734f05a666f98ce162dcc6/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:15.764996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:15.766787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:15.792791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33262f0-6346-418a-a3fd-674747655bc1 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:15.947747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:15.948631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:15.948949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:15.960353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] PATH_INFO: `/v3/projects/da67af8e65ae432e9a3b6abc5367d618` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:15.962227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da67af8e65ae432e9a3b6abc5367d618)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:15.964401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:15.975229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:16.030397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:16.032212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.069825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da67af8e65ae432e9a3b6abc5367d618', 'request_id': 'req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.076238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:16.077395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da67af8e65ae432e9a3b6abc5367d618', 'request_id': 'req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.092938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da67af8e65ae432e9a3b6abc5367d618', 'request_id': 'req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.117055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] The token cache is being invalidate because project da67af8e65ae432e9a3b6abc5367d618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:16.117339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.117983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9312709-0f50-49d5-bd7b-608f86c5b53e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:16.119682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.129361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 941/1880] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:15 2022] DELETE /identity/v3/projects/da67af8e65ae432e9a3b6abc5367d618 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:16.130403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:16.133967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.226345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:16.227014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.227435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.227715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.230743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.236300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8d3a-08c2-4c17-a9d8-24d193e4d0e0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:16.251758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:16.252498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.252977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.253306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] PATH_INFO: `/v3/users/ad08ec1b0e1e4b2ab536a9d7a60a4141` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.255035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad08ec1b0e1e4b2ab536a9d7a60a4141)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:16.257266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:16.334323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad08ec1b0e1e4b2ab536a9d7a60a4141'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.340653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:16.342278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96633f06-44c5-47d9-8bde-1be341608ae4 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:16.344923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad08ec1b0e1e4b2ab536a9d7a60a4141'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.346222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad08ec1b0e1e4b2ab536a9d7a60a4141'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.348392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad08ec1b0e1e4b2ab536a9d7a60a4141'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.354739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 940/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:16.356540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1193f-c1b8-4cae-a06c-6b6c468d18f2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.357086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1193f-c1b8-4cae-a06c-6b6c468d18f2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.357240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1193f-c1b8-4cae-a06c-6b6c468d18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.359205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e8b41615-c553-4d86-99cf-c5f2e0b4d48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad08ec1b0e1e4b2ab536a9d7a60a4141'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:16.380267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-86c1193f-c1b8-4cae-a06c-6b6c468d18f2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:16.381596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-86c1193f-c1b8-4cae-a06c-6b6c468d18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.384220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 942/1882] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:16 2022] DELETE /identity/v3/users/ad08ec1b0e1e4b2ab536a9d7a60a4141 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:16.389280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.390814 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.390960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.430819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:16.432368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.448304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:16.542750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 941/1883] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:16.545126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1620-d1e3-4354-beda-e012b552e43e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.545584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1620-d1e3-4354-beda-e012b552e43e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.546209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1620-d1e3-4354-beda-e012b552e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.571308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 943/1884] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:16.582615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:16.584370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.593661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6bdb1620-d1e3-4354-beda-e012b552e43e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:16.596374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6bdb1620-d1e3-4354-beda-e012b552e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.633716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 942/1885] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:16.644538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d80-ce99-4ce3-8733-21e1d8128d9e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.644837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d80-ce99-4ce3-8733-21e1d8128d9e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.647143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d80-ce99-4ce3-8733-21e1d8128d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.703077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-de375d80-ce99-4ce3-8733-21e1d8128d9e None None] MFA Rules not processed for user `4e4f951732734f05a666f98ce162dcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:16.704887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-de375d80-ce99-4ce3-8733-21e1d8128d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.714867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32ed20-a265-42e0-98ae-cbf13b2b4281 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:16.718732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:16.719377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.719661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.720003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.736578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:16.738447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:16.740972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:16.770620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 944/1886] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:16.772425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:16.799543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34539ae-f288-481a-9ee2-042f9d646dc6 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:16.818324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:16.818962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.819257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.819523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.820228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:16.820542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:16.822624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:16.826741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 943/1887] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:16.840437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.840991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.841463 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.860483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 945/1888] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:16.865945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:16.891940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4014-2371-4707-a3ec-5ffc82c17f38 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:16.894478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] MFA Rules not processed for user `83483d0c21604057910a6a27eb681b89`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:16.896723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:16.917049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:16.921097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:16.921097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:16.922506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:16.923878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:16.928625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:16.987708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 946/1889] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:16.992792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.007266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 944/1890] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:17.020781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.025301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.099293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955289-813b-4cc3-95ee-31b183d3e8c6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.105702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.107184 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.107872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.108163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.108871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.110887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.144110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 947/1891] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:16 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:17.149313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.166123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768dedb-81fb-4787-8a2e-5708be1edbc7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.176680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cae-5a21-44d5-a8ef-eb57436c0598 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.187806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.188734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.188957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.189421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.190160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.193404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.212839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 948/1892] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:17.216826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.233802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:17.254938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70dee2-e309-40bb-8c3b-72126d91ab83 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.261985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.262654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.263503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.263503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.263987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.265595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.266754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:17.279405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 949/1893] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:17.280379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.282342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.286045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.286750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.287097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.287440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.289855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.295566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7555d9-f6a7-4844-b43d-b9def09dd9ef admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.300326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.302074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.302074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.302074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] PATH_INFO: `/v3/projects/8f080f4f55fe4622a626a510c0fd5805` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.303241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f080f4f55fe4622a626a510c0fd5805)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.305448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.361912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.363523 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f080f4f55fe4622a626a510c0fd5805', 'request_id': 'req-60297909-88ae-4f06-a73f-b16a509bda82'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.363669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.370608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f080f4f55fe4622a626a510c0fd5805', 'request_id': 'req-60297909-88ae-4f06-a73f-b16a509bda82'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.374862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 945/1894] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:17.375798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.390541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a978-4e42-4cde-ae8d-62f1fbaeca8c service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.394649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f080f4f55fe4622a626a510c0fd5805', 'request_id': 'req-60297909-88ae-4f06-a73f-b16a509bda82'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.416938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] The token cache is being invalidate because project 8f080f4f55fe4622a626a510c0fd5805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:17.417273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.418714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.424551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 950/1895] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:17 2022] DELETE /identity/v3/projects/8f080f4f55fe4622a626a510c0fd5805 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:17.426963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.428886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.480586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.481305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.481590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.481864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] PATH_INFO: `/v3/projects/513298197fc54d098518ee9036691180/users/b1534546e7024f919542941db3b07a24/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.501664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513298197fc54d098518ee9036691180, user_id=b1534546e7024f919542941db3b07a24, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.504424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876918f6-c3b5-4206-80cc-af9538e1c853 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.527566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 946/1896] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:17 2022] PUT /identity/v3/projects/513298197fc54d098518ee9036691180/users/b1534546e7024f919542941db3b07a24/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:17.538785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.539140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.541240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.548143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60297909-88ae-4f06-a73f-b16a509bda82 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.584778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] MFA Rules not processed for user `b1534546e7024f919542941db3b07a24`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:17.586442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.623883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.625436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.625719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.625997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] PATH_INFO: `/v3/users/ad7d49fea9254ecc9d93483cddd91fa6` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.627168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7d49fea9254ecc9d93483cddd91fa6)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:17.629123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:17.664840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:17.700889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 947/1897] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:17.719856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:17.724920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:17.728344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7d49fea9254ecc9d93483cddd91fa6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.733428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:17.738572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7d49fea9254ecc9d93483cddd91fa6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.739520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7d49fea9254ecc9d93483cddd91fa6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.740616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7d49fea9254ecc9d93483cddd91fa6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.753975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7d49fea9254ecc9d93483cddd91fa6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:17.804718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 951/1898] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:17 2022] DELETE /identity/v3/users/ad7d49fea9254ecc9d93483cddd91fa6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:17.813120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006130-aa2e-4c55-9ef3-14706df4d1e0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:17.905556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:17.906298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:17.906579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:17.906850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:17.908816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:18.067249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:18.069326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82cdbf-be5e-454c-9e6f-d8943d2628dd service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:18.094301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 948/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:18.728393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:18.730623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:18.834652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc552fd-5faa-47eb-84dd-3d7184c316cd admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:18.839878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:18.840529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:18.840799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:18.841066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] PATH_INFO: `/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:18.842236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d77c23d39d348c5bf51f9ae8f869f86)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:18.844204 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:18.897163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d77c23d39d348c5bf51f9ae8f869f86', 'request_id': 'req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:18.906101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d77c23d39d348c5bf51f9ae8f869f86', 'request_id': 'req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:18.917804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d77c23d39d348c5bf51f9ae8f869f86', 'request_id': 'req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:18.930964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] The token cache is being invalidate because project 6d77c23d39d348c5bf51f9ae8f869f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:18.931323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:18.932048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-04c15ef5-bd17-4d8c-b3af-29de5a59f4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:18.933999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 952/1900] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:18 2022] DELETE /identity/v3/projects/6d77c23d39d348c5bf51f9ae8f869f86 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:18.939288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:18.939903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:18.939903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:18.964222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:18.965558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:19.044044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 949/1901] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:19.055997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.055997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.055997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.079283 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:19.080562 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:19.089737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 953/1902] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:19.094062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.105119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c82059-efd4-42ed-ac5e-8f89103c5dc9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.110771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.111410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.111684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.112594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.112756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:19.112948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.114590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.151297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 950/1903] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:50:19.152739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.167084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea62e1-49a1-405c-a0c9-150a276ebffe None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.176629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.177341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.177618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.177888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.178572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.180739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.225762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 954/1904] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:19 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:19.226936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.235558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:19.244307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f7e3-6db2-4b6f-a321-ef4355e9cdd2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.310331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.311140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.311602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.311896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.312535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.314471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.344748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 951/1905] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:19 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:19.349109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.355652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:19.361930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fc944-721d-46b1-85fe-2b6067b70c58 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.368934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.370069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.370069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.370346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.371237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.373038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.387559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 955/1906] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:19.391216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.401946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c785a-1ded-4bd4-8d1a-455d02086916 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.409768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.410523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.410897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.411280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.412143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.413999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755c889-0ab1-4d05-bf9e-e940b696c8e4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.429267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 952/1907] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:19.430728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.441626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b888af-1019-41bb-89c7-9799f0ab8109 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.447534 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.449068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.449607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.449607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] PATH_INFO: `/v3/projects/1e992575c39742d9b8a2c60d3429d8ca/users/58baaf0cb6314ef1b1adccb4e6846e49/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.481236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e992575c39742d9b8a2c60d3429d8ca, user_id=58baaf0cb6314ef1b1adccb4e6846e49, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.484157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.510207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 956/1908] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:19 2022] PUT /identity/v3/projects/1e992575c39742d9b8a2c60d3429d8ca/users/58baaf0cb6314ef1b1adccb4e6846e49/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:19.524129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.524512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.524942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.573555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] MFA Rules not processed for user `58baaf0cb6314ef1b1adccb4e6846e49`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:19.575140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:19.691036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 953/1909] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:19.703142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:19.705205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:19.826585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6961b-58f6-4c7a-a216-c3aa2370b2a7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:19.832895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:19.842304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:19.842744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:19.843256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:19.856611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:19.858416 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc8ad-cc5a-4fc5-84c4-4d76a2b31841 service glance] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:19.881505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 957/1910] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:20.746735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:20.749187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:20.831374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d2156-8e4c-42c1-943b-97e915e73299 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:20.837038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:20.837703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:20.838359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:20.838359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] PATH_INFO: `/v3/users/1e0cd522aa294533b69dca16bfa79077` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:20.839425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0cd522aa294533b69dca16bfa79077)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:20.841427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:20.855069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:20.898883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0cd522aa294533b69dca16bfa79077'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:20.907008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0cd522aa294533b69dca16bfa79077'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:20.908016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0cd522aa294533b69dca16bfa79077'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:20.908671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0cd522aa294533b69dca16bfa79077'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:20.920112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0cd522aa294533b69dca16bfa79077'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:20.953979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 954/1911] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:20 2022] DELETE /identity/v3/users/1e0cd522aa294533b69dca16bfa79077 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:20.958819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:20.959461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:20.959461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:20.991497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:20.993121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:21.087843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 958/1912] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:21.096858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:21.100666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:21.199762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96100-bec5-4af0-8924-4a6081707a3c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:21.210855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:21.212267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:21.212791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:21.213307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:21.236014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:21.237975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:21.257644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 955/1913] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:21.887011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:21.888815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:21.913497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ee7e-eaa0-4a13-b1bf-66a43d17eca3 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:21.935600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:21.939167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:21.939454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:21.944186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] PATH_INFO: `/v3/projects/1a78e681ca38422d98e8aff2c7b4ff51` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:21.944186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a78e681ca38422d98e8aff2c7b4ff51)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:21.945624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:22.094201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a78e681ca38422d98e8aff2c7b4ff51', 'request_id': 'req-15830db6-2255-46a6-b74e-a19589669d79'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.103162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a78e681ca38422d98e8aff2c7b4ff51', 'request_id': 'req-15830db6-2255-46a6-b74e-a19589669d79'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.116806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a78e681ca38422d98e8aff2c7b4ff51', 'request_id': 'req-15830db6-2255-46a6-b74e-a19589669d79'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.125978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:22.141784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] The token cache is being invalidate because project 1a78e681ca38422d98e8aff2c7b4ff51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:22.142462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.144325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.147362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 959/1914] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:21 2022] DELETE /identity/v3/projects/1a78e681ca38422d98e8aff2c7b4ff51 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:22.152402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:22.173150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2fe6-e70f-471d-a93e-3aa496b585c0 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:22.280622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:22.281342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:22.281937 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:22.282361 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] PATH_INFO: `/v3/users/e49cec80c169445ea2c8a14657786c96` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:22.283747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49cec80c169445ea2c8a14657786c96)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:22.285938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:22.345249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:22.361124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49cec80c169445ea2c8a14657786c96'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.373820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49cec80c169445ea2c8a14657786c96'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.374718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49cec80c169445ea2c8a14657786c96'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.375349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49cec80c169445ea2c8a14657786c96'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.388229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49cec80c169445ea2c8a14657786c96'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:22.417233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 956/1915] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:22 2022] DELETE /identity/v3/users/e49cec80c169445ea2c8a14657786c96 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:22.877371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:22.880751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:22.895994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15830db6-2255-46a6-b74e-a19589669d79 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:22.995530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:22.996286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:22.996564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:22.996838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] PATH_INFO: `/v3/projects/5ce2fd0e1d08408a99e9752e0c6c1174` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:22.998035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce2fd0e1d08408a99e9752e0c6c1174)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:23.000252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:23.068669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce2fd0e1d08408a99e9752e0c6c1174', 'request_id': 'req-3513bad4-bc1e-4c2e-af85-ebc672131627'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.079641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce2fd0e1d08408a99e9752e0c6c1174', 'request_id': 'req-3513bad4-bc1e-4c2e-af85-ebc672131627'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.090238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce2fd0e1d08408a99e9752e0c6c1174', 'request_id': 'req-3513bad4-bc1e-4c2e-af85-ebc672131627'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.117077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] The token cache is being invalidate because project 5ce2fd0e1d08408a99e9752e0c6c1174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:23.118068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.118342 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.120574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 960/1916] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:22 2022] DELETE /identity/v3/projects/5ce2fd0e1d08408a99e9752e0c6c1174 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:23.123759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:23.125074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:23.125752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:23.126943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:23.156634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511c333-b276-4615-a96f-97a927430b3b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:23.235554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:23.236498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:23.236878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:23.237419 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] PATH_INFO: `/v3/users/3a3a9f0f4dc6490c930277de9ca935a1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:23.239360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3a9f0f4dc6490c930277de9ca935a1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:23.243844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513bad4-bc1e-4c2e-af85-ebc672131627 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:23.244135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:23.250955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:23.253726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:23.254592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:23.254592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] PATH_INFO: `/v3/users/a07707f44f1c4c91821fe27629825944` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:23.256597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07707f44f1c4c91821fe27629825944)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:23.259973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:23.315504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:23.362209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3a9f0f4dc6490c930277de9ca935a1'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.379467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3a9f0f4dc6490c930277de9ca935a1'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.380598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3a9f0f4dc6490c930277de9ca935a1'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.381362 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3a9f0f4dc6490c930277de9ca935a1'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.392619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07707f44f1c4c91821fe27629825944'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.398106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3affae62-58e9-4111-967d-82bb930f3a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3a9f0f4dc6490c930277de9ca935a1'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.403418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07707f44f1c4c91821fe27629825944'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.403418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07707f44f1c4c91821fe27629825944'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.404101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07707f44f1c4c91821fe27629825944'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.416532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07707f44f1c4c91821fe27629825944'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:23.436623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 957/1917] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:23 2022] DELETE /identity/v3/users/3a3a9f0f4dc6490c930277de9ca935a1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:23.443420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:23.444014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:23.444434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:23.452065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 961/1918] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:23 2022] DELETE /identity/v3/users/a07707f44f1c4c91821fe27629825944 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:23.476351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:23.480248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:23.529916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:23.583135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 958/1919] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:23.601664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:23.603282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:23.679970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8196-891b-42bb-aacc-7b33f484866e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:23.683972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:23.684627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:23.684950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:23.685322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:23.706865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:23.713280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:23.723360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 962/1920] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:24.213337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:24.216143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.233117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af01de-d05d-4920-8e5b-4b16b7c3dfe2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:24.240272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:24.241271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.241271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.241647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] PATH_INFO: `/v3/users/b1534546e7024f919542941db3b07a24` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.243318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1534546e7024f919542941db3b07a24)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:24.246570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:24.250921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:24.254238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.290937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb70f3-16f5-4561-9f23-acb266a8796e service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:24.308819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:24.309921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.310425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.310831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] PATH_INFO: `/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.316964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98849e40e7934a7bb86c9fa1e03bf3ce)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:24.320737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:24.365720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1534546e7024f919542941db3b07a24'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.376014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1534546e7024f919542941db3b07a24'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.376892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1534546e7024f919542941db3b07a24'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.377613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1534546e7024f919542941db3b07a24'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.391220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-069556b2-f87b-416e-8186-0a1a389ae63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1534546e7024f919542941db3b07a24'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.421924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 959/1921] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:24 2022] DELETE /identity/v3/users/b1534546e7024f919542941db3b07a24 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:24.424355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.424608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.424791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.429745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98849e40e7934a7bb86c9fa1e03bf3ce', 'request_id': 'req-07f80c27-39d1-4d19-a056-dbdbc6e46564'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.441781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98849e40e7934a7bb86c9fa1e03bf3ce', 'request_id': 'req-07f80c27-39d1-4d19-a056-dbdbc6e46564'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.451244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:24.453264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98849e40e7934a7bb86c9fa1e03bf3ce', 'request_id': 'req-07f80c27-39d1-4d19-a056-dbdbc6e46564'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.454940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.467022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] The token cache is being invalidate because project 98849e40e7934a7bb86c9fa1e03bf3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:24.467333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.468118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-07f80c27-39d1-4d19-a056-dbdbc6e46564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.472531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 963/1922] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:24 2022] DELETE /identity/v3/projects/98849e40e7934a7bb86c9fa1e03bf3ce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:24.475385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.475669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.475980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.511395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:24.515927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.581526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 960/1923] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:24.584392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:24.599994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.609172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:24.618073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3f4fe-748a-434b-99ed-9edf6cfe2d1e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:24.624985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:24.625708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.626287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.626581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] PATH_INFO: `/v3/projects/9e5e008e62e549ef81a0ed9880a185e5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.628061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5e008e62e549ef81a0ed9880a185e5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:24.630157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:24.692278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 964/1924] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:24.693966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:24.697328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.752322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:24.768414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5e008e62e549ef81a0ed9880a185e5', 'request_id': 'req-2487d880-641f-4af4-85f1-f17f2385b7f6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.817265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5e008e62e549ef81a0ed9880a185e5', 'request_id': 'req-2487d880-641f-4af4-85f1-f17f2385b7f6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.817597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f8c91-2af0-4bf4-acdc-4539424ecf2c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:24.828471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5e008e62e549ef81a0ed9880a185e5', 'request_id': 'req-2487d880-641f-4af4-85f1-f17f2385b7f6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.851314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] The token cache is being invalidate because project 9e5e008e62e549ef81a0ed9880a185e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:24.852015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.853516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-2487d880-641f-4af4-85f1-f17f2385b7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:24.860117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 961/1925] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:24 2022] DELETE /identity/v3/projects/9e5e008e62e549ef81a0ed9880a185e5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:24.865360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.866085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.866652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.896742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:24.897394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:24.897703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:24.898088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:24.901470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:24.907900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:24.910221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:25.001868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.003350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4e64-96d9-4aa1-b546-a71aa2a9f34c service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.014713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 965/1926] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:25.016120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c660d6-43e4-4861-a30c-f526031b657d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.016503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c660d6-43e4-4861-a30c-f526031b657d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.016714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c660d6-43e4-4861-a30c-f526031b657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.017604 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 962/1927] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:25.022127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.033575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a47c7-9ed4-419f-b4f7-3aa080d953d1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.039660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.040568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.040853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.041131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.042239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:25.042239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.043816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.044415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-69c660d6-43e4-4861-a30c-f526031b657d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:25.045694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-69c660d6-43e4-4861-a30c-f526031b657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:25.055291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 966/1928] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:25.058682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 963/1929] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:50:25.063055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.063457 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.063853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.064099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.082956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1eeb-be17-444d-baa7-5574fc823abf admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.087126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:25.088874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:25.097374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.098552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.099122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.099689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.101644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.103633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 967/1930] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:25.104712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.106760 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.117812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba7e75-6722-4d8b-9160-f8f36b29577b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.137795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.138926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.139641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.140274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.141637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:25.142622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.145351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.177130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 964/1931] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:25.184178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.191018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 968/1932] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:25.194068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.223553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff96e-d9cb-4a28-b9bd-93b1deab7f7d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.230238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:25.391230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5411b2-395b-4e8d-aa88-db93fd4b0369 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.408967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.411170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.411830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.412447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.413882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.416533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.417340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.417629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.417908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.418753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.419160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.423646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.502151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 965/1933] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:25.505484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.516142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 969/1934] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:25.520252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.534393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d682cb-911b-4d0c-a758-e6fae3bb44af admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.589053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:25.662407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2cd04-2294-4561-ae95-2be5d73b52f0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.674809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.676222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.677006 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.677517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.677752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.678142 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.678494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.678824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.679758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.681356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.682572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.685464 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.713275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 966/1935] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:25.716552 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.719017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:25.738754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd4c52-624e-452f-b23f-217ac44055d8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.746990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.748725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.749014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.749284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] PATH_INFO: `/v3/projects/513298197fc54d098518ee9036691180` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.750583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=513298197fc54d098518ee9036691180)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.752588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.755235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 970/1936] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:25 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:25.757074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.788714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd3b4-c2f8-4a30-867a-b6102b03fcae admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.794677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:25.795734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:25.796130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:25.796469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:25.797312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:25.799059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:25.815610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 971/1937] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:25.815610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.830422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e8c90-2690-427c-9fa8-4dfba6b6b6dd admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:25.862395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513298197fc54d098518ee9036691180', 'request_id': 'req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:25.879036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513298197fc54d098518ee9036691180', 'request_id': 'req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:25.903514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513298197fc54d098518ee9036691180', 'request_id': 'req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:25.939977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] The token cache is being invalidate because project 513298197fc54d098518ee9036691180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:25.940828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:25.942822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:25.948726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 967/1938] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:25 2022] DELETE /identity/v3/projects/513298197fc54d098518ee9036691180 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:25.954832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:25.956589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.083368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.084276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.084820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.085360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.086992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.093007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cd6fc-596c-4722-ab3e-af2839fa4017 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.121895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ff83-0e6a-4528-9db4-2036b17fa44b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.130171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.131161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.132069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.132427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] PATH_INFO: `/v3/projects/b3382458e8fe412c99a44ecdaca62405/users/fba69c224ed7446db886133b67f922e9/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.136680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 972/1939] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:26.143834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163495-5e8b-4117-89f9-a72891b3d304 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.147994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163495-5e8b-4117-89f9-a72891b3d304 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.148880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163495-5e8b-4117-89f9-a72891b3d304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.158938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3382458e8fe412c99a44ecdaca62405, user_id=fba69c224ed7446db886133b67f922e9, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.163944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.203902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 968/1940] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:25 2022] PUT /identity/v3/projects/b3382458e8fe412c99a44ecdaca62405/users/fba69c224ed7446db886133b67f922e9/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:26.203902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.220907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-da163495-5e8b-4117-89f9-a72891b3d304 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:26.220907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-da163495-5e8b-4117-89f9-a72891b3d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.222799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.248241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:26.299302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:26.383619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 973/1941] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:26.386348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.387581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.387581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.424665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429cad-a672-4f79-9aca-c60eebfb87fd admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.434418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.435488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.435778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.436256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.437488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.444720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf525-2eab-4233-a460-27891927b386 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.460458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] MFA Rules not processed for user `fba69c224ed7446db886133b67f922e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:26.465183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.471598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 969/1942] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:26.475170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.476001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.476870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.513064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:26.514917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.536304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 970/1943] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:26.537383 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.560096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26c32a-74d6-451e-b889-980f57e394fd None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.569356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.570539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.571036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.571496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] PATH_INFO: `/v3/projects/bca6865aa79e4c63a5d12047f25948f2/users/7367b9cdd0e24fe48303e477e5fdff4c/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.597183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 974/1944] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:26.597183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.603924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca6865aa79e4c63a5d12047f25948f2, user_id=7367b9cdd0e24fe48303e477e5fdff4c, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.608615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.609762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a74ac-f1e6-4b80-b001-1b93245997e2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.616550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.617448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.618103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.618582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.619839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:26.619839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.621448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.636700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 975/1945] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:26.638025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.638699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 971/1946] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:26 2022] PUT /identity/v3/projects/bca6865aa79e4c63a5d12047f25948f2/users/7367b9cdd0e24fe48303e477e5fdff4c/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:26.646241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.650157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.748275 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e126fc-9081-4bf7-85ca-38d44e92b537 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.774093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d44b7-0fdb-4e60-9c0f-6f8abf4c09ae admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.779342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.780032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.780318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.780592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.781270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.783300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae4093-fb40-4881-bae9-4b680f46450f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.818323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 972/1947] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:26.819588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.819912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.820217 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.831233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:26.845028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:26.845957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:26.846286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:26.846596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:26.854630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] MFA Rules not processed for user `7367b9cdd0e24fe48303e477e5fdff4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:26.857011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.923372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:26.924909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:26.935666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 976/1948] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:26.936700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.951842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336bf3-70d3-46c7-9bfc-9dd8a064a078 service glance] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:26.970430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 973/1949] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:26.983091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:26.984597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:26.991089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:27.047456 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.048151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.048453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.048711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.049357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.051702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.070116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e4cda-a9f3-4341-b7f8-0a385f882ab5 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.074626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.075414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.075710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.076139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.087005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.088565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.090621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 977/1950] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:26 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:27.095664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.104161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 974/1951] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:27.113596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07f64-2f45-484f-b227-ba11436bb924 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.121652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.122323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.122705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.123077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.124326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.132789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.134320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.151324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 978/1952] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:27.155170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.155612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da453799-89b2-4500-8630-cc53870db9b3 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.162575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.163627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.164187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.164898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] PATH_INFO: `/v3/users/7367b9cdd0e24fe48303e477e5fdff4c` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.167177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7367b9cdd0e24fe48303e477e5fdff4c)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.170853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.176207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb77bbe-f531-412c-a180-2a3ebe5f75e5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.192262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.192262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.192262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.192262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.193591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.195832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.213437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 979/1953] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:27.215923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.228198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acffb6-ce2f-4279-9e61-afdc3304e64f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.250055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.250859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.251475 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.251767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] PATH_INFO: `/v3/projects/e502501840214be9ba7c6e52a936b700/users/2d2fe40262e64209afc9836a36c2ef45/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.278663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7367b9cdd0e24fe48303e477e5fdff4c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:27.306550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e502501840214be9ba7c6e52a936b700, user_id=2d2fe40262e64209afc9836a36c2ef45, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.328973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4d162-8fc9-4d3c-b956-5b1906a70a1f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.331411 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7367b9cdd0e24fe48303e477e5fdff4c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:27.334723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7367b9cdd0e24fe48303e477e5fdff4c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:27.336904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7367b9cdd0e24fe48303e477e5fdff4c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:27.353271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-225433cd-136d-4bcc-b797-b6ff85fee4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7367b9cdd0e24fe48303e477e5fdff4c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:27.363898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 980/1954] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:27 2022] PUT /identity/v3/projects/e502501840214be9ba7c6e52a936b700/users/2d2fe40262e64209afc9836a36c2ef45/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:27.384215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.385066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.386227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.399846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 975/1955] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:27 2022] DELETE /identity/v3/users/7367b9cdd0e24fe48303e477e5fdff4c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:27.404420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.404825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.405068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.438255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:27.444543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:27.473359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] MFA Rules not processed for user `2d2fe40262e64209afc9836a36c2ef45`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:27.476340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:27.560925 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 976/1956] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:27.569008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:27.577423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.580027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:27.639219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:27.641179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 981/1957] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:27.647083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.649782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:27.748404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910ec1c-88eb-4e9b-b3ff-65042917da59 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.790758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.791407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.791688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.791994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.792666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.794919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.820910 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed343b9-974b-4c29-a103-9339b44ee039 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:27.833660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:27.834632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:27.834977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:27.835318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:27.849955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:27.853331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:27.882293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 977/1958] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:27.947993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 982/1959] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:27 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:27.961120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:27.999949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815224-664f-42f4-944f-9f94bddd1f43 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.086895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.087732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.088072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.088351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.089084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.091401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.154897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 978/1960] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:27 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:28.159082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.176510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b74d6-d3e8-4133-bed2-0aef18af5741 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.185046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.185917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.186282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.186577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.187618 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.191461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.218230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 983/1961] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:28.218804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.247633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac80c1-727f-4d4d-aab3-4f6280cb9d36 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.254524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.256274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.256453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.256781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.257554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.259311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16729c-cbd2-4ada-8c82-9937d9bd07a0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.279711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 979/1962] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:28.281159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.295831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512747d-26e1-4795-a4f9-cb23a9741d59 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.302964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.303716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.304042 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.304326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] PATH_INFO: `/v3/projects/0d624a75b07047f2bd2c535c8ec0b767/users/d6944ba3beb2420685e991c7e92fceb5/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.328542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d624a75b07047f2bd2c535c8ec0b767, user_id=d6944ba3beb2420685e991c7e92fceb5, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.331504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.352807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 984/1963] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:28 2022] PUT /identity/v3/projects/0d624a75b07047f2bd2c535c8ec0b767/users/d6944ba3beb2420685e991c7e92fceb5/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:28.364444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102f72-6cba-456c-953d-426df1934e9b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.364791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102f72-6cba-456c-953d-426df1934e9b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.365208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102f72-6cba-456c-953d-426df1934e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.423581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.437518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-da102f72-6cba-456c-953d-426df1934e9b None None] MFA Rules not processed for user `d6944ba3beb2420685e991c7e92fceb5`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:28.439026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-da102f72-6cba-456c-953d-426df1934e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:28.443330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:28.565412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2deeb-a2c1-48e5-a8c7-5b061d1b450a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.571868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 980/1964] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:28.574668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102f72-6cba-456c-953d-426df1934e9b None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.576772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.579382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.579852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.580231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] PATH_INFO: `/v3/projects/bca6865aa79e4c63a5d12047f25948f2` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.581985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca6865aa79e4c63a5d12047f25948f2)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.584666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.598701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102f72-6cba-456c-953d-426df1934e9b None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.606267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.607316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.607844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.608348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.609585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.613861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.656711 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca6865aa79e4c63a5d12047f25948f2', 'request_id': 'req-ac433fb6-ceab-49cf-855a-d5ee8223cf85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:28.668446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca6865aa79e4c63a5d12047f25948f2', 'request_id': 'req-ac433fb6-ceab-49cf-855a-d5ee8223cf85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:28.669209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 981/1965] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:28 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:28.673119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.682548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca6865aa79e4c63a5d12047f25948f2', 'request_id': 'req-ac433fb6-ceab-49cf-855a-d5ee8223cf85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:28.688960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:28.698396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] The token cache is being invalidate because project bca6865aa79e4c63a5d12047f25948f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:28.698725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:28.699429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:28.701333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 985/1966] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:28 2022] DELETE /identity/v3/projects/bca6865aa79e4c63a5d12047f25948f2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:28.771596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660641-3006-49aa-a71c-9361f1abaaf6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.777742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.778391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.778668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.778985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.779607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.781710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.820272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 982/1967] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:28 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:28.823310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.826235 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:28.834299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:28.926189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433fb6-ceab-49cf-855a-d5ee8223cf85 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:28.932812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:28.933469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:28.933746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:28.934015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:28.935151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:28.936619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:28.954331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 986/1968] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:28.956329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:28.990462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47eda-0e04-4579-b85a-134190963ff9 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:29.001618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:29.002693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:29.003141 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:29.003581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] PATH_INFO: `/v3/projects/0876efd382c94ce8966c6aa3d0518cb6/users/52563a03bede4eefb718de8c32e91db9/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:29.038473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0876efd382c94ce8966c6aa3d0518cb6, user_id=52563a03bede4eefb718de8c32e91db9, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:29.041960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:29.061670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 983/1969] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:28 2022] PUT /identity/v3/projects/0876efd382c94ce8966c6aa3d0518cb6/users/52563a03bede4eefb718de8c32e91db9/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:29.066638 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:29.088218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7995fb-a60a-45bf-b0ae-27c51ed4016d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:29.165509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:29.166056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:29.166335 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:29.166603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:29.167252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:29.168948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff496e-35c9-4833-9fdc-e6a3605593c4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:29.180433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 987/1970] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:29.185055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:29.196375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc716-cfdd-4078-8d7e-09ddb276cbb6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:29.209171 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:29.210420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:29.210897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:29.212440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] PATH_INFO: `/v3/projects/0876efd382c94ce8966c6aa3d0518cb6/users/52563a03bede4eefb718de8c32e91db9/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:29.216133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0876efd382c94ce8966c6aa3d0518cb6, user_id=52563a03bede4eefb718de8c32e91db9, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:29.220561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:29.240653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 984/1971] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:29 2022] PUT /identity/v3/projects/0876efd382c94ce8966c6aa3d0518cb6/users/52563a03bede4eefb718de8c32e91db9/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:29.264084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:29.264482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:29.264824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:29.318344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] MFA Rules not processed for user `52563a03bede4eefb718de8c32e91db9`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:29.320787 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:29.467720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 988/1972] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:29.486102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:29.489170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:29.572930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5c34-77c8-42ed-b0f1-68f51e3da633 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:29.577459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:29.578209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:29.578536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:29.578879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:29.581377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:29.664448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:29.667153 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:29.681386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 985/1973] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:31.458339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:31.470999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034915-d5f7-4620-a4b8-b3f3b17817b0 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:31.476085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:31.477620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:31.477882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:31.478216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:31.480491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:31.503367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:31.570102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:31.573039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:31.587666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 989/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:32.369697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:32.371507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:32.385904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39eff-adcb-4a28-b280-a22109ced3d9 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:32.390859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:32.391668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:32.392161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:32.392717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:32.414253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:32.415771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:32.426862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 986/1975] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:32.515984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:32.527117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88287e-9d80-49d5-9104-84c82f795da5 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:32.531466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:32.532021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:32.532322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:32.532606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:32.534580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:32.629918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:32.631708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98856517-393a-40bf-918d-bb405842e98b service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:32.645047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 990/1976] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:36.636405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:36.641975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:36.739958 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcd9f-bb9c-4890-bc38-984720457037 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:36.745097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:36.746139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:36.746139 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:36.746512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] PATH_INFO: `/v3/users/2d2fe40262e64209afc9836a36c2ef45` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:36.747846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2fe40262e64209afc9836a36c2ef45)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:36.750075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:36.809521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2fe40262e64209afc9836a36c2ef45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:36.821120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2fe40262e64209afc9836a36c2ef45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:36.821983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2fe40262e64209afc9836a36c2ef45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:36.822721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2fe40262e64209afc9836a36c2ef45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:36.854856 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2fe40262e64209afc9836a36c2ef45'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:36.886988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 987/1977] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:36 2022] DELETE /identity/v3/users/2d2fe40262e64209afc9836a36c2ef45 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:36.891818 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:36.892483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:36.892676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:36.916453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:36.918145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:36.998635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 991/1978] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:37.008442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:37.010158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:37.073938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4befb05-a89e-41cb-98f4-b72c091859d8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:37.077756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:37.078375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:37.078657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:37.078911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:37.093325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:37.094807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:37.105305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 988/1979] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:37.434500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:37.436633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:37.454990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d0103-f74f-4d47-81e5-a979f248e719 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:37.460992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:37.461601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:37.461823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:37.462182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] PATH_INFO: `/v3/projects/e502501840214be9ba7c6e52a936b700` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:37.463380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e502501840214be9ba7c6e52a936b700)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:37.465400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:37.515726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:37.517267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e502501840214be9ba7c6e52a936b700', 'request_id': 'req-819965f5-4905-4d5d-b8be-c555cc12dd17'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.526007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e502501840214be9ba7c6e52a936b700', 'request_id': 'req-819965f5-4905-4d5d-b8be-c555cc12dd17'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.536563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e502501840214be9ba7c6e52a936b700', 'request_id': 'req-819965f5-4905-4d5d-b8be-c555cc12dd17'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.551241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] The token cache is being invalidate because project e502501840214be9ba7c6e52a936b700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:37.551586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.552487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.554123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 992/1980] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:37 2022] DELETE /identity/v3/projects/e502501840214be9ba7c6e52a936b700 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:37.558336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:37.569614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9103435-a5a9-46e2-8ead-e1d8a076b18d service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:37.594488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:37.677267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:37.679893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:37.683346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:37.684176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] PATH_INFO: `/v3/users/d6944ba3beb2420685e991c7e92fceb5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:37.689370 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6944ba3beb2420685e991c7e92fceb5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:37.696199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:37.856384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6944ba3beb2420685e991c7e92fceb5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.874207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6944ba3beb2420685e991c7e92fceb5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.876002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6944ba3beb2420685e991c7e92fceb5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.877321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6944ba3beb2420685e991c7e92fceb5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.896633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6944ba3beb2420685e991c7e92fceb5'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:37.927589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 989/1981] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:37 2022] DELETE /identity/v3/users/d6944ba3beb2420685e991c7e92fceb5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:38.332131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:38.333975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:38.349538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819965f5-4905-4d5d-b8be-c555cc12dd17 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:38.428811 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:38.430150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:38.431057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:38.431572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] PATH_INFO: `/v3/projects/0d624a75b07047f2bd2c535c8ec0b767` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:38.433418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d624a75b07047f2bd2c535c8ec0b767)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:38.436053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:38.512410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d624a75b07047f2bd2c535c8ec0b767', 'request_id': 'req-3e70b991-a722-4e4d-bb86-efb3259d86f4'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.519652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d624a75b07047f2bd2c535c8ec0b767', 'request_id': 'req-3e70b991-a722-4e4d-bb86-efb3259d86f4'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.531390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d624a75b07047f2bd2c535c8ec0b767', 'request_id': 'req-3e70b991-a722-4e4d-bb86-efb3259d86f4'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.553914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] The token cache is being invalidate because project 0d624a75b07047f2bd2c535c8ec0b767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:38.560440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.561573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.564687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 993/1982] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:38 2022] DELETE /identity/v3/projects/0d624a75b07047f2bd2c535c8ec0b767 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:38.568758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:38.570266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:38.592297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4854-b80b-40a6-a9d7-02e526dc0b0c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:38.738154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:38.738886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:38.739093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:38.739360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] PATH_INFO: `/v3/users/52563a03bede4eefb718de8c32e91db9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:38.740597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=52563a03bede4eefb718de8c32e91db9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:38.742544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:38.826199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:38.828771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52563a03bede4eefb718de8c32e91db9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.842123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52563a03bede4eefb718de8c32e91db9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.843146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52563a03bede4eefb718de8c32e91db9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.844678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52563a03bede4eefb718de8c32e91db9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.853827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-09adb2d1-6729-4c71-863a-c1d1f2e88dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52563a03bede4eefb718de8c32e91db9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:38.877777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 990/1983] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:38 2022] DELETE /identity/v3/users/52563a03bede4eefb718de8c32e91db9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:39.284428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:39.286691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:39.317890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b991-a722-4e4d-bb86-efb3259d86f4 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:39.432632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:39.433306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:39.433586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:39.433858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] PATH_INFO: `/v3/projects/0876efd382c94ce8966c6aa3d0518cb6` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:39.435000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0876efd382c94ce8966c6aa3d0518cb6)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:39.437124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:39.448512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:39.521193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0876efd382c94ce8966c6aa3d0518cb6', 'request_id': 'req-d720e791-35e0-478d-b234-53e615c27341'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:39.532666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0876efd382c94ce8966c6aa3d0518cb6', 'request_id': 'req-d720e791-35e0-478d-b234-53e615c27341'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:39.568714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0876efd382c94ce8966c6aa3d0518cb6', 'request_id': 'req-d720e791-35e0-478d-b234-53e615c27341'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:39.589249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] The token cache is being invalidate because project 0876efd382c94ce8966c6aa3d0518cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:39.589539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:39.590288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d720e791-35e0-478d-b234-53e615c27341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:39.598232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 994/1984] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:39 2022] DELETE /identity/v3/projects/0876efd382c94ce8966c6aa3d0518cb6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:39.600055 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:39.600324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:39.600583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:39.634393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:39.636515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:39.736053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 991/1985] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:39.749704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:39.750265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:39.750740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:39.794435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:39.797655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:39.839373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 995/1986] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:39.840135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:39.869959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec70658-602c-4754-9ea2-23cba288b0cf None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:39.877302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:39.877979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:39.878377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:39.878657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:39.880222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:39.880872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:39.882690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:39.911826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 992/1987] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:50:39.918211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:39.938374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ae220-d743-4985-860d-b47c4e5f7969 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:39.961035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:39.962270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:39.963756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:39.964321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:39.966793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:39.971561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.041649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 996/1988] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:39 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:40.043721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.056406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4051-0f25-453b-9054-d1ba3fe54eb6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.172133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.172887 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.173224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.173498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.174358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.177270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.211629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 993/1989] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:40 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:40.217085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.231263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a747e-93db-48f5-b037-3dbf47aeb53f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.240332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.241379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.241661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.241940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.242663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.244659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.263096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 997/1990] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:40.268125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.281697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348f6c-9a20-44c1-a9f9-95d0e5fa1491 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.287146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.287817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.288098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.288373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.289708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.291503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452991-d779-4e09-81cd-280e7f4a35fb admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.307243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 994/1991] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:40.311635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.325565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085743b-6ff7-48a4-ae84-b974f763111d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.331479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.332214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.332516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.332773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] PATH_INFO: `/v3/projects/7132060fa88748e59abc5e9756b37473/users/4ba12f639a304980a50b966c58ff09af/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.353846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7132060fa88748e59abc5e9756b37473, user_id=4ba12f639a304980a50b966c58ff09af, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.356942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.372734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 998/1992] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:40 2022] PUT /identity/v3/projects/7132060fa88748e59abc5e9756b37473/users/4ba12f639a304980a50b966c58ff09af/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:40.385317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.385669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.385950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.434101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] MFA Rules not processed for user `4ba12f639a304980a50b966c58ff09af`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:40.435355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:40.455397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:40.522545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 995/1993] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:40.535547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.537532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:40.645442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:40.647928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:40.655255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5660-7575-4a3e-b3ee-9311102758c2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.665112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.666122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.666515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.667008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.683200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.684883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c86ec4-5480-42ec-bf8a-652f0d33339a service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.697297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 999/1994] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:40.750182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95274-b922-4fb6-9880-17b6da9b9640 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:40.755267 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:40.755968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.756250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.757271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] PATH_INFO: `/v3/users/58baaf0cb6314ef1b1adccb4e6846e49` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.758135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58baaf0cb6314ef1b1adccb4e6846e49)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:40.760498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:40.841022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58baaf0cb6314ef1b1adccb4e6846e49'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:40.858795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58baaf0cb6314ef1b1adccb4e6846e49'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:40.859660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58baaf0cb6314ef1b1adccb4e6846e49'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:40.860392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58baaf0cb6314ef1b1adccb4e6846e49'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:40.870093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58baaf0cb6314ef1b1adccb4e6846e49'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:40.898275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 996/1995] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:40 2022] DELETE /identity/v3/users/58baaf0cb6314ef1b1adccb4e6846e49 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:40.905137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:40.905478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:40.905733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:40.933444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:40.934985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:40.981171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:41.020946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1000/1996] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:41.037594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:41.041402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:41.114132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:41.137858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f516b-c9c8-4fb7-9057-e4c503735b12 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:41.143048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:41.144214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:41.145389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:41.145839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:41.160440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:41.162177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154cf70-8dce-4b3b-93b5-f1d2dd54bf3b service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:41.177576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 997/1997] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:41.544791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:41.546955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:41.574717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f5d2-3f42-4889-abc8-25080ff37419 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:41.592423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:41.593597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:41.594066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:41.594543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] PATH_INFO: `/v3/projects/1e992575c39742d9b8a2c60d3429d8ca` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:41.601343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e992575c39742d9b8a2c60d3429d8ca)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:41.605270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:41.735953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e992575c39742d9b8a2c60d3429d8ca', 'request_id': 'req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:41.747776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e992575c39742d9b8a2c60d3429d8ca', 'request_id': 'req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:41.761197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e992575c39742d9b8a2c60d3429d8ca', 'request_id': 'req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:41.782684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] The token cache is being invalidate because project 1e992575c39742d9b8a2c60d3429d8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:41.783199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:41.784307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-00cd5f65-c2d8-49a7-a7a8-ab63987a43ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:41.787157 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1001/1998] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:41 2022] DELETE /identity/v3/projects/1e992575c39742d9b8a2c60d3429d8ca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:41.794155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:41.794437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:41.794840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:41.821660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:41.823725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:41.913322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 998/1999] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:41.921737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:41.922035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:41.922307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:41.957672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:41.959106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:41.968728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1002/2000] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:41.973523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:41.984741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd55e-34a3-42e9-ba52-778829fd77c8 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:41.992120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:41.993486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:41.994252 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:41.994412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:41.995539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:41.996092 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:41.998608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.026163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 999/2001] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:42.031065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.050876 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3042c-010c-4b75-a77c-da784d5bc61c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.059644 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.061279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.061585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.061858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.062817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.065399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.104547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1003/2002] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:42 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:42.107847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.120359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc533d8b-915a-49b8-b841-91c2e19d4632 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.218509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.219163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.219437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.219705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.220381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.222423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.247935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1000/2003] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:42 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:42.252823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.267370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca2b90-18df-413f-b4c1-7ef0c00e2709 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.275411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.276105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.276383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.276655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.277326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.279130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.291681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1004/2004] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:42.296298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.319023 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4a83-f08a-4319-9566-ed12cbb17a88 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.325965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.326903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.327218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.327518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.328311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.330044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d3c3-04fa-465c-aacf-7163c9617a9f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.350076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1001/2005] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:42.356748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.376024 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e050-b917-43e1-a735-2a3085580817 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.385639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.386075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.386436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.386920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] PATH_INFO: `/v3/projects/21c7058580774c7fb482d174cb851c3b/users/c0b9467bba7d46339954405ce6240e16/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.428792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7058580774c7fb482d174cb851c3b, user_id=c0b9467bba7d46339954405ce6240e16, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.432026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.455072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1005/2006] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:42 2022] PUT /identity/v3/projects/21c7058580774c7fb482d174cb851c3b/users/c0b9467bba7d46339954405ce6240e16/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:42.466799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.467063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.467336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.505236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] MFA Rules not processed for user `c0b9467bba7d46339954405ce6240e16`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:42.506544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:42.568266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:42.630553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1002/2007] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:42.636470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.707845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:42.723341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12918947-afac-43cc-be6d-77b96f710176 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.732406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.733449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.734651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.735383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.736691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.739502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.787848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1006/2008] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:42 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:42.789480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:42.808722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc10a02-28f5-408c-bb60-a0c7b1bb169c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:42.921279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:42.922494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:42.922806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:42.923285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:42.924443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:42.928256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:42.984970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1003/2009] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:42 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:42.991317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.024702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63402102-dae5-4833-b7f1-30a66a997fbd admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.034675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.036052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.036791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.037491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.038972 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.042809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.073582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1007/2010] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:43.078575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.121367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc26aa-940d-40c0-9535-74cfc5f6180d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.141580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.143880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.144358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.144843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.146127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.149969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeee02-22a7-4fa0-afb7-91f7294b9460 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.169835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1004/2011] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:43.176231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.198484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf6db-cc11-4ba7-a034-2bfeecc05ce6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.205479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.206645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.207153 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.207639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] PATH_INFO: `/v3/projects/93a019092f0b409baaffca14cd01a6b0/users/ff44bb62a77f4b4db5fa0ee64bae8142/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.234988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a019092f0b409baaffca14cd01a6b0, user_id=ff44bb62a77f4b4db5fa0ee64bae8142, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.238502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.263302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1008/2012] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:43 2022] PUT /identity/v3/projects/93a019092f0b409baaffca14cd01a6b0/users/ff44bb62a77f4b4db5fa0ee64bae8142/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:43.276674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.277222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.277680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.323535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] MFA Rules not processed for user `ff44bb62a77f4b4db5fa0ee64bae8142`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:43.325422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:43.424572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1005/2013] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:43.426734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.541651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e73f-00e9-4c07-ba1d-8006d1c3096b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.547286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.547967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.548244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.548512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.549164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.551460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.595264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1009/2014] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:43 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:43.600781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.616255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebebb1-aae3-4727-b6f4-8ad6e773a93e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.741528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:43.771837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.771837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.771837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.771837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.772529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.774420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.807843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1006/2015] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:43 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:43.810489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.823752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcef93-8aeb-4f6f-939a-ef5698beb1a8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.829870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.830645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.831017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.831383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.832265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.834017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.847008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1010/2016] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:43.858312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.877644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2238-d07a-45e9-b3fd-cf8c54f75d82 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:43.886273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:43.887427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:43.887972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:43.888456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] PATH_INFO: `/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098/users/e5742f127d9c4820a6794dd5df39f86e/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:43.926896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=337dabfd49a64b9d8ef2b5a52a4c2098, user_id=e5742f127d9c4820a6794dd5df39f86e, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:43.942196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:43.972155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1007/2017] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:43 2022] PUT /identity/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098/users/e5742f127d9c4820a6794dd5df39f86e/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:43.977608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:43.993574 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ab77-b96c-48b0-8322-4aa7118b896b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:44.087522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:44.088382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:44.088655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:44.088851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:44.089765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:44.091651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32581fc0-bede-4cb5-9400-3eecda92c7f9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:44.111058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1011/2018] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:44.112478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:44.125158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a4ae-4daa-4813-9a67-5a926a291c3e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:44.131007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:44.132037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:44.132406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:44.132834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] PATH_INFO: `/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098/users/e5742f127d9c4820a6794dd5df39f86e/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:44.135571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337dabfd49a64b9d8ef2b5a52a4c2098, user_id=e5742f127d9c4820a6794dd5df39f86e, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:44.139030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:44.158010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1008/2019] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:44 2022] PUT /identity/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098/users/e5742f127d9c4820a6794dd5df39f86e/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:44.170298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:44.170917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:44.171512 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:44.229798 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] MFA Rules not processed for user `e5742f127d9c4820a6794dd5df39f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:44.232503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:44.267536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:44.486469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1012/2020] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:44.499279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:44.501327 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:44.585403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4f8c-6908-4648-927b-c67f4a14ef19 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:44.592417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:44.593455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:44.593920 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:44.594384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:44.694994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:44.697525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865746b9-5ca2-4018-8efb-e6f40b68542e service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:44.712871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1009/2021] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:46.727467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:46.730209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:46.775507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484deb8-7fb1-45fb-9f0a-04440a34c299 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:46.780330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:46.782706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:46.782998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:46.783444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:46.910568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:46.912396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:46.925646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1013/2022] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:47.419705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:47.420741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:47.421163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:47.450270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] MFA Rules not processed for user `dc57e9716aa849a9864745592e920c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:47.451666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:47.513199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:47.534822 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1010/2023] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:48.131100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:48.143107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e560b-35cf-428d-b0a6-e639e5694670 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:48.148259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:48.149191 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:48.149469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:48.149739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:48.162593 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:48.164727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c9a55-5b43-4ac4-84a0-352a54b9eb12 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:48.179397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1014/2024] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:51.931632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:52.039231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df173890-dfe8-44a3-9768-d344ac890e7d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:52.046525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:52.047418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:52.047852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:52.048384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] PATH_INFO: `/v3/users/c0b9467bba7d46339954405ce6240e16` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:52.050329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b9467bba7d46339954405ce6240e16)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:52.053074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:52.117360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b9467bba7d46339954405ce6240e16'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.129940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b9467bba7d46339954405ce6240e16'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.130820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b9467bba7d46339954405ce6240e16'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.131701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b9467bba7d46339954405ce6240e16'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.143010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b9467bba7d46339954405ce6240e16'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.168307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1011/2025] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:51 2022] DELETE /identity/v3/users/c0b9467bba7d46339954405ce6240e16 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:52.170454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:52.171692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:52.172027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:52.198685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:52.200725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:52.287754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1015/2026] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:52.299180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:52.301740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:52.372254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354351e-e7bb-4bf0-94c1-b7d66e671dd8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:52.377292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:52.378125 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:52.378569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:52.379049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:52.390253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:52.392119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:52.410994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1012/2027] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:52.844509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:52.846778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:52.864782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73723e-6da5-4fe3-9688-4daeff40b541 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:52.870612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:52.871933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:52.872684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:52.873120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] PATH_INFO: `/v3/projects/21c7058580774c7fb482d174cb851c3b` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:52.874483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c7058580774c7fb482d174cb851c3b)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:52.876351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:52.912081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:52.951415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c7058580774c7fb482d174cb851c3b', 'request_id': 'req-10749004-d936-4f0f-aa2b-eedd0a311036'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.960226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c7058580774c7fb482d174cb851c3b', 'request_id': 'req-10749004-d936-4f0f-aa2b-eedd0a311036'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.974748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c7058580774c7fb482d174cb851c3b', 'request_id': 'req-10749004-d936-4f0f-aa2b-eedd0a311036'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.996316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] The token cache is being invalidate because project 21c7058580774c7fb482d174cb851c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:52.996606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.997527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:52.999479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1016/2028] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:52 2022] DELETE /identity/v3/projects/21c7058580774c7fb482d174cb851c3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:53.003611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:53.046636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05920b45-4e83-4494-9174-50b1ee44121a service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:53.065395 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:53.132968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:53.134846 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:53.135311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:53.135586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] PATH_INFO: `/v3/users/ff44bb62a77f4b4db5fa0ee64bae8142` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:53.136986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff44bb62a77f4b4db5fa0ee64bae8142)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:53.138954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:53.227739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff44bb62a77f4b4db5fa0ee64bae8142'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.239403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff44bb62a77f4b4db5fa0ee64bae8142'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.240803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff44bb62a77f4b4db5fa0ee64bae8142'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.241782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff44bb62a77f4b4db5fa0ee64bae8142'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.256489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff44bb62a77f4b4db5fa0ee64bae8142'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.301265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1013/2029] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:53 2022] DELETE /identity/v3/users/ff44bb62a77f4b4db5fa0ee64bae8142 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:53.679748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:53.683298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:53.728309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10749004-d936-4f0f-aa2b-eedd0a311036 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:53.740899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:53.742746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:53.850466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:53.851431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:53.851774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:53.852131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] PATH_INFO: `/v3/projects/93a019092f0b409baaffca14cd01a6b0` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:53.857270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a019092f0b409baaffca14cd01a6b0)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:53.859732 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:53.862269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea105-c9f2-4ac7-b124-de030e2676df admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:53.870138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:53.870906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:53.871209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:53.871484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] PATH_INFO: `/v3/users/4ba12f639a304980a50b966c58ff09af` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:53.872923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba12f639a304980a50b966c58ff09af)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:53.875219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:53.937786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a019092f0b409baaffca14cd01a6b0', 'request_id': 'req-0c1383e9-da61-4f86-b49a-32612e8c6674'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.948149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:53.951105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a019092f0b409baaffca14cd01a6b0', 'request_id': 'req-0c1383e9-da61-4f86-b49a-32612e8c6674'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.963603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba12f639a304980a50b966c58ff09af'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.968221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a019092f0b409baaffca14cd01a6b0', 'request_id': 'req-0c1383e9-da61-4f86-b49a-32612e8c6674'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.981182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba12f639a304980a50b966c58ff09af'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.984349 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba12f639a304980a50b966c58ff09af'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:53.985546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba12f639a304980a50b966c58ff09af'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.000319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-715bb97f-0e15-4db4-b762-13978f7ba9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba12f639a304980a50b966c58ff09af'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.007089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] The token cache is being invalidate because project 93a019092f0b409baaffca14cd01a6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:54.008718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.010532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.014490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1017/2030] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:53 2022] DELETE /identity/v3/projects/93a019092f0b409baaffca14cd01a6b0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:54.018726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:54.025651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:54.025934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1014/2031] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:53 2022] DELETE /identity/v3/users/4ba12f639a304980a50b966c58ff09af => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:54.031284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:54.031570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:54.031997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:54.062742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:54.065188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:54.085043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:54.127035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1383e9-da61-4f86-b49a-32612e8c6674 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:54.156367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1015/2032] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:54.167076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:54.168876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:54.227210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:54.228503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:54.228975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:54.229429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] PATH_INFO: `/v3/users/e5742f127d9c4820a6794dd5df39f86e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:54.230989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5742f127d9c4820a6794dd5df39f86e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:54.233974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:54.265792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602d84b-75a1-499c-b56a-5950ab90c2e1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:54.274705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:54.276173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:54.276849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:54.277291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:54.303835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:54.303835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:54.315328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1016/2033] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:50:54.329993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5742f127d9c4820a6794dd5df39f86e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.341077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5742f127d9c4820a6794dd5df39f86e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.342163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5742f127d9c4820a6794dd5df39f86e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.343228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5742f127d9c4820a6794dd5df39f86e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.358205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8f84fc30-b21e-4383-b132-89bfff34d05e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5742f127d9c4820a6794dd5df39f86e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:54.394350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1018/2034] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:54 2022] DELETE /identity/v3/users/e5742f127d9c4820a6794dd5df39f86e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:54.974213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:54.993024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18327aba-7db5-413e-a0ed-250c42521e75 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.121927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.122643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.122861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.123421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] PATH_INFO: `/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.125408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] RBAC: Authorizing `identity:delete_project(project_id=337dabfd49a64b9d8ef2b5a52a4c2098)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.127891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.130542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:55.209499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337dabfd49a64b9d8ef2b5a52a4c2098', 'request_id': 'req-6627c940-4138-41d8-8769-6a6c74fe669f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.228830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337dabfd49a64b9d8ef2b5a52a4c2098', 'request_id': 'req-6627c940-4138-41d8-8769-6a6c74fe669f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.236943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337dabfd49a64b9d8ef2b5a52a4c2098', 'request_id': 'req-6627c940-4138-41d8-8769-6a6c74fe669f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.249853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] The token cache is being invalidate because project 337dabfd49a64b9d8ef2b5a52a4c2098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:55.250316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.251067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.253073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1017/2035] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:54 2022] DELETE /identity/v3/projects/337dabfd49a64b9d8ef2b5a52a4c2098 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:55.262825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8bb46-6ba1-42d9-b10a-0c641b4fa1dc None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.263549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8bb46-6ba1-42d9-b10a-0c641b4fa1dc None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.265344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8bb46-6ba1-42d9-b10a-0c641b4fa1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.292177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-96b8bb46-6ba1-42d9-b10a-0c641b4fa1dc None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:55.293848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-96b8bb46-6ba1-42d9-b10a-0c641b4fa1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:55.420880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.426982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:55.436614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1019/2036] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:55.445163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.445454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.445986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.471944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:55.482052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627c940-4138-41d8-8769-6a6c74fe669f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.482278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:55.483893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:55.492784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.493436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.493777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.494227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] PATH_INFO: `/v3/projects/7132060fa88748e59abc5e9756b37473` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.496088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7132060fa88748e59abc5e9756b37473)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.498116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.498799 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1020/2037] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:50:55.504388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.515767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f6ad-419b-4978-b5a4-00d5e7141891 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.522844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.523596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.524029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.525211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.525211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:55.525561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.526975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.552825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1021/2038] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:55.557966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.573542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31cfad-ee27-4ccf-a764-2e581620b58a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.575656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7132060fa88748e59abc5e9756b37473', 'request_id': 'req-a378cf53-1ec5-41ba-9667-e3c79cbf2951'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.592512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7132060fa88748e59abc5e9756b37473', 'request_id': 'req-a378cf53-1ec5-41ba-9667-e3c79cbf2951'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.599803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7132060fa88748e59abc5e9756b37473', 'request_id': 'req-a378cf53-1ec5-41ba-9667-e3c79cbf2951'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.611736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] The token cache is being invalidate because project 7132060fa88748e59abc5e9756b37473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:55.612262 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.612936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:55.614446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1018/2039] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:55 2022] DELETE /identity/v3/projects/7132060fa88748e59abc5e9756b37473 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:55.643886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.644537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.644815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.645092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.645770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.647824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.687194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1022/2040] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:55 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:55.691901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.693576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:55.708191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cf53-1ec5-41ba-9667-e3c79cbf2951 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.800168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.800824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.801101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.801366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.802036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.804201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.841914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1019/2041] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:55 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:50:55.846589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.860131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4df56-1f68-49b6-abf5-059aadf3864f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.866077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.866735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.867086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.867312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.868715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.870411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.881921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1023/2042] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:50:55.887026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.892835 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:55.899851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d988a6-3735-4328-80ca-d8d59b5bcb0a admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.907445 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.908106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.908473 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.908645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.909597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.911647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6814-8cb1-480f-8f12-0fe005341f0d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.928520 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1020/2043] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:50:55.929596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:55.941382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a334c-4470-4b57-b8e2-90b6f0e7cb95 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:55.948142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:55.948945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.949225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.949499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] PATH_INFO: `/v3/projects/e37a09b8aa67497a88534e340bf0320d/users/374c1346638943cf9b8cb85445626e09/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:55.967977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37a09b8aa67497a88534e340bf0320d, user_id=374c1346638943cf9b8cb85445626e09, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:55.970657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:55.986140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1024/2044] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:50:55 2022] PUT /identity/v3/projects/e37a09b8aa67497a88534e340bf0320d/users/374c1346638943cf9b8cb85445626e09/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:55.998229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:55.998584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:55.998952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:56.032027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] MFA Rules not processed for user `374c1346638943cf9b8cb85445626e09`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:56.033437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:56.119367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1021/2045] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:56.131896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:56.134491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:56.229614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6569-88a6-4882-8e73-71b56719c982 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:56.234319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:56.235050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:56.235430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:56.235891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:56.248085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:56.249585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c86ec-4e02-475e-989e-581d3c0d89a3 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:56.268472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1025/2046] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:57.338956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:57.341392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:57.428108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec837b-f175-4dd8-b1d9-d4243b5358c2 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:57.434621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:57.435428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:57.438255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:57.438255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] PATH_INFO: `/v3/users/fba69c224ed7446db886133b67f922e9` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:57.438255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba69c224ed7446db886133b67f922e9)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:57.441394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:57.517479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba69c224ed7446db886133b67f922e9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:57.529197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba69c224ed7446db886133b67f922e9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:57.530112 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba69c224ed7446db886133b67f922e9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:57.530987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba69c224ed7446db886133b67f922e9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:57.553156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba69c224ed7446db886133b67f922e9'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:57.574155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:57.581594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1022/2047] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:57 2022] DELETE /identity/v3/users/fba69c224ed7446db886133b67f922e9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:57.586749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:57.588681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:57.589409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:57.626985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:57.626985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:57.695337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:57.743189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1026/2048] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:57.758446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:57.761029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:57.886495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499ee73-12ff-40a9-93d7-9678c7525850 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:57.897862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:57.900001 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:57.900500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:57.901332 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:57.928434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:57.930477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:57.944772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1023/2049] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:50:58.099154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:58.103158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:58.136154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055bb0-3794-45c4-93cc-47b40d075352 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:58.143745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:58.144520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:58.144772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:58.145206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] PATH_INFO: `/v3/users/83483d0c21604057910a6a27eb681b89` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:58.147178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83483d0c21604057910a6a27eb681b89)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:58.149979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:58.234918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83483d0c21604057910a6a27eb681b89'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.253710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83483d0c21604057910a6a27eb681b89'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.254737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83483d0c21604057910a6a27eb681b89'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.255578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83483d0c21604057910a6a27eb681b89'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.272394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83483d0c21604057910a6a27eb681b89'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.330654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1027/2050] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:58 2022] DELETE /identity/v3/users/83483d0c21604057910a6a27eb681b89 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:58.488909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:58.490722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:58.519652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faee1b-7117-4492-ad3e-792d898bd1f3 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:58.658080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:58.658696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:58.659054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:58.659283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] PATH_INFO: `/v3/projects/b3382458e8fe412c99a44ecdaca62405` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:58.672707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3382458e8fe412c99a44ecdaca62405)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:58.678692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:58.762931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:58.764468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:58.784710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50cff-95b7-431e-8f1b-09ed608d2745 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:58.790174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3382458e8fe412c99a44ecdaca62405', 'request_id': 'req-5a238bb4-2db8-489c-81a9-d1f935489e58'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.801318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3382458e8fe412c99a44ecdaca62405', 'request_id': 'req-5a238bb4-2db8-489c-81a9-d1f935489e58'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.808451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3382458e8fe412c99a44ecdaca62405', 'request_id': 'req-5a238bb4-2db8-489c-81a9-d1f935489e58'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.825227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] The token cache is being invalidate because project b3382458e8fe412c99a44ecdaca62405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:58.825833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.827659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-5a238bb4-2db8-489c-81a9-d1f935489e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.830429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1024/2051] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:58 2022] DELETE /identity/v3/projects/b3382458e8fe412c99a44ecdaca62405 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:58.832072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a69ef-6bbc-435f-a2da-77b3baad4b17 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:58.832355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a69ef-6bbc-435f-a2da-77b3baad4b17 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:58.832625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a69ef-6bbc-435f-a2da-77b3baad4b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:58.860537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:58.861337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:58.861689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:58.862034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] PATH_INFO: `/v3/projects/2b66288166da45e8abf82fabd0ed19a9` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:58.863930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b66288166da45e8abf82fabd0ed19a9)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:58.865463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:58.866643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8d6a69ef-6bbc-435f-a2da-77b3baad4b17 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:58.868871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8d6a69ef-6bbc-435f-a2da-77b3baad4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:58.917948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:58.924675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b66288166da45e8abf82fabd0ed19a9', 'request_id': 'req-3098e3a4-042b-47e4-b937-f5396c3ff4f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.932748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b66288166da45e8abf82fabd0ed19a9', 'request_id': 'req-3098e3a4-042b-47e4-b937-f5396c3ff4f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.935502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:58.947637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b66288166da45e8abf82fabd0ed19a9', 'request_id': 'req-3098e3a4-042b-47e4-b937-f5396c3ff4f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.960266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1025/2052] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:50:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:58.967840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:58.968131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:58.968405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:58.969185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] The token cache is being invalidate because project 2b66288166da45e8abf82fabd0ed19a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:58.969652 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.970527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:58.973833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1028/2053] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:58 2022] DELETE /identity/v3/projects/2b66288166da45e8abf82fabd0ed19a9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:58.977705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:58.979337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:58.997959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:59.001045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.075122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e3a4-042b-47e4-b937-f5396c3ff4f6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.083601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.084308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.084586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.084859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] PATH_INFO: `/v3/users/4e4f951732734f05a666f98ce162dcc6` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.085002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1026/2054] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:59.086061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.086798 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4f951732734f05a666f98ce162dcc6)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.087881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.089220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.161975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4f951732734f05a666f98ce162dcc6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.170821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4f951732734f05a666f98ce162dcc6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.171564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4f951732734f05a666f98ce162dcc6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.172326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4f951732734f05a666f98ce162dcc6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.184745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-fbe2dc26-136e-45f2-a33e-e6779978fe97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4f951732734f05a666f98ce162dcc6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.207590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb94b5-7b37-4747-8237-835d929dd424 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.207590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.207590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.207590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.208067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.208067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.209890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1029/2055] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:50:58 2022] DELETE /identity/v3/users/4e4f951732734f05a666f98ce162dcc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:50:59.211449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.211875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.212384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.243669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:59.245492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.325025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.329776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.345898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1030/2056] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:50:59.349733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1027/2057] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:50:59.350720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.364310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:59.369684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bafec1-c561-4e81-965d-d445492bc027 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.377312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.378073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.378176 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.378654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.379315 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:50:59.379622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.381596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.413169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1031/2058] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:50:59.413389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.432544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640dabd-59af-4b4c-9bd3-15e65785a0cd service swift] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.440335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.442691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.443255 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.445309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.447754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.449205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.492571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.498801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.533782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:59.553742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1028/2059] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:50:59 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:59.557430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eaba7-a20a-47c9-9271-4f97c400ce38 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.559541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.680999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.682581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.683154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.683596 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] PATH_INFO: `/v3/projects/c1b18bf103ca4f349410f974d727f54e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.685613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b18bf103ca4f349410f974d727f54e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.689359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.708017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb93ee1-3e17-4a0a-9636-50588fb88815 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:50:59.757338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:50:59.758044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.758354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.758720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.759647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:50:59.769537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:50:59.776746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b18bf103ca4f349410f974d727f54e', 'request_id': 'req-a7e4c534-8e06-42b0-9f00-adbdc43110e8'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.788135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b18bf103ca4f349410f974d727f54e', 'request_id': 'req-a7e4c534-8e06-42b0-9f00-adbdc43110e8'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.803026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b18bf103ca4f349410f974d727f54e', 'request_id': 'req-a7e4c534-8e06-42b0-9f00-adbdc43110e8'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.818382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] The token cache is being invalidate because project c1b18bf103ca4f349410f974d727f54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:50:59.819105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.820143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a7e4c534-8e06-42b0-9f00-adbdc43110e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:50:59.824701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1032/2060] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:50:59 2022] DELETE /identity/v3/projects/c1b18bf103ca4f349410f974d727f54e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:50:59.839298 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf7e1-91e8-423b-856a-3c7c397deeca None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:50:59.839730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf7e1-91e8-423b-856a-3c7c397deeca None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:50:59.840310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf7e1-91e8-423b-856a-3c7c397deeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:50:59.866932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1029/2061] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:50:59 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:50:59.885188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:50:59.890534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.897913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ee6bf7e1-91e8-423b-856a-3c7c397deeca None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:50:59.899627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ee6bf7e1-91e8-423b-856a-3c7c397deeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:50:59.935031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57e1e-85c1-40cc-ab61-b5bb2f4c2512 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.034290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.035193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.035404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.035680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.036488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.038227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.043341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1033/2062] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:00.053108 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.053554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.053974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.069237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1030/2063] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:00.075097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.080836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:00.082900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:00.100444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aadb9-0e65-44c5-99fb-9b37b186fc93 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.101321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1034/2064] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:00.117710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.121099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.123429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.124077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.127199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.130643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.132606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.157715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485054-4d94-42fa-9ba4-b40bf927b706 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.175776 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.176539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.176842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.180867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.180867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:51:00.180867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.181288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1031/2065] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:00.182682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.186324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.208883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfefd7-8d2f-4f59-aabe-88dd85b4793b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.213387 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:00.237026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1035/2066] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:51:00.242996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.243672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.248057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.248367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.248628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] PATH_INFO: `/v3/projects/b5894afcd8e44031a855a39f937a076e/users/ed7ceabc060244609d195cd57313aabf/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.298213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796316bb-3642-44cc-9e43-9534f6d9086e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.323525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5894afcd8e44031a855a39f937a076e, user_id=ed7ceabc060244609d195cd57313aabf, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.327738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87034b-77bf-4d89-9764-0679de8a454b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.334062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.337168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.337651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.337964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.338836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.346341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.359077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1032/2067] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:00 2022] PUT /identity/v3/projects/b5894afcd8e44031a855a39f937a076e/users/ed7ceabc060244609d195cd57313aabf/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:00.366655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.367030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.367609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.411175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1036/2068] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:51:00 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:00.412689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.437602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:00.441771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:00.627076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:00.658446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8daf-e33b-4b16-9c6c-579520a5c040 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.666941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1033/2069] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:00.671395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.672116 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.672796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.673086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.674830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.677400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.709968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.712013 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:00.802020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1037/2070] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:51:00 2022] POST /identity/v3/users => generated 282 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:00.809835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.868087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789757-2790-4726-af76-c2c82582be4b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.883529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.884255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.884589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.884821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.885544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.890661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:00.920411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1038/2071] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:00.924626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:00.945530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ba59-bc1c-4d81-a497-3f97211f45c8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.965409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb03ac-b24f-41ca-99d4-cd6da8e1de8d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:00.984148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.984865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.985152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.986476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:00.986775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.987982 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:00.988259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:00.989497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:00.990642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:00.992489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:01.027731 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:01.030008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad6f1-87b6-4a1c-bd0a-273789ed16f5 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:01.042969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1039/2072] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:01.044713 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:01.048393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1034/2073] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:51:01.067648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368550-77c8-4683-b124-905e8e888061 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:01.077673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:01.077673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:01.077673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:01.077673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] PATH_INFO: `/v3/projects/ab7063f2fc7d46fe8238c3908e1fbfd7/users/ae9e111d5656491abc9a1d9374c70bec/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:01.097105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7063f2fc7d46fe8238c3908e1fbfd7, user_id=ae9e111d5656491abc9a1d9374c70bec, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:01.100959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:01.138720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1040/2074] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:01 2022] PUT /identity/v3/projects/ab7063f2fc7d46fe8238c3908e1fbfd7/users/ae9e111d5656491abc9a1d9374c70bec/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:01.274648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ca78-4d86-4f05-bc05-eb5f2d9b1f3d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:01.275012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ca78-4d86-4f05-bc05-eb5f2d9b1f3d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:01.275169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ca78-4d86-4f05-bc05-eb5f2d9b1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:01.334828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bcb7ca78-4d86-4f05-bc05-eb5f2d9b1f3d None None] MFA Rules not processed for user `ae9e111d5656491abc9a1d9374c70bec`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:01.338863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bcb7ca78-4d86-4f05-bc05-eb5f2d9b1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:01.541156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1035/2075] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:01.559375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:01.562251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:01.697138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd3e2a-aec0-42b4-bc49-3affdc3ed101 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:01.719627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:01.720753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:01.721203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:01.721692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:01.748367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:01.751550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:01.787270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1041/2076] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:11.447275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:11.448138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:11.448138 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:11.506713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] MFA Rules not processed for user `ed7ceabc060244609d195cd57313aabf`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:11.510576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:11.521611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:11.529440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:11.615587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:11.748409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe023-fda9-4281-8d0d-7536dfda6b1d service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:11.753870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:11.754668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:11.755009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:11.755770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] PATH_INFO: `/v3/users/374c1346638943cf9b8cb85445626e09` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:11.756722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=374c1346638943cf9b8cb85445626e09)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:11.759390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:11.808879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1036/2077] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:11.815486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:11.853274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a2ca6-5c9e-4cf9-9817-20d1bfa5e404 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:11.880911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:11.881690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:11.882097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:11.882849 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:11.883285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:11.885400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:11.916377 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:11.959890 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374c1346638943cf9b8cb85445626e09'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:11.995722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1037/2078] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:51:11.997628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.010817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374c1346638943cf9b8cb85445626e09'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:12.013743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374c1346638943cf9b8cb85445626e09'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:12.016185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374c1346638943cf9b8cb85445626e09'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:12.064320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b3f0b63-e7ab-4a72-b019-4f796ce4ee5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374c1346638943cf9b8cb85445626e09'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:12.138377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1042/2079] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:51:11 2022] DELETE /identity/v3/users/374c1346638943cf9b8cb85445626e09 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:12.145774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.148841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.150875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.162067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83155-8209-401c-8757-4a01ade43391 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.219273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:12.221771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:12.284234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.284802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.285071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.285343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.286084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.288275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.346571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1038/2080] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:51:11 2022] POST /identity/v3/users => generated 298 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:12.348096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.351686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:12.386084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b271e-f41e-4fe5-ba63-4fe982cfc5ff admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.394676 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1043/2081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:12.396529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.396691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.397170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.397448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.397761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.398472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.399278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:12.400353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.437741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1039/2082] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:12.439147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.466417 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb3619-4920-4551-b739-f37b4cd28d4b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.477372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.478712 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.479218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.482499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] PATH_INFO: `/v3/projects/cee8613516974c61885373bc97a28e2d/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.505662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:12.529605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426276-148d-4f22-8ceb-503822c76d5a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.537247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.538161 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.539345 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee8613516974c61885373bc97a28e2d, user_id=dd4bca8a3cfd4e9a9cc3aae67fbc1270, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.539571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.539944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.546606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.552817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.555256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.579718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1044/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:12.585485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1040/2084] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:12 2022] PUT /identity/v3/projects/cee8613516974c61885373bc97a28e2d/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:51:12.589904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.602337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af6cb-4e6d-447c-8026-b5d98005a305 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.685033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.685723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.685997 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.688689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.699595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.706173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.741164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1045/2085] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:51:12.745435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:12.762983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bef049-5a7c-46c9-ad8b-46ffefa2b03e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:12.774940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:12.776575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:12.777048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:12.777704 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] PATH_INFO: `/v3/projects/cee8613516974c61885373bc97a28e2d/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:12.781614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee8613516974c61885373bc97a28e2d, user_id=dd4bca8a3cfd4e9a9cc3aae67fbc1270, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:12.789569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3236c-406d-4a03-90eb-adb20188939a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:12.803668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1041/2086] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:12 2022] PUT /identity/v3/projects/cee8613516974c61885373bc97a28e2d/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:13.300510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:13.303477 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:13.358948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857850a-91a7-4612-a40f-1ec13e759cdc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:13.472793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:13.473487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:13.473772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:13.474104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] PATH_INFO: `/v3/projects/e37a09b8aa67497a88534e340bf0320d` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:13.475730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37a09b8aa67497a88534e340bf0320d)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:13.478216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:13.579398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37a09b8aa67497a88534e340bf0320d', 'request_id': 'req-cac93c22-04d1-4df6-9504-e3190408b38a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:13.620501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37a09b8aa67497a88534e340bf0320d', 'request_id': 'req-cac93c22-04d1-4df6-9504-e3190408b38a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:13.652355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37a09b8aa67497a88534e340bf0320d', 'request_id': 'req-cac93c22-04d1-4df6-9504-e3190408b38a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:13.687962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] The token cache is being invalidate because project e37a09b8aa67497a88534e340bf0320d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:51:13.688346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:13.689225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cac93c22-04d1-4df6-9504-e3190408b38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:13.693288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1046/2087] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:51:13 2022] DELETE /identity/v3/projects/e37a09b8aa67497a88534e340bf0320d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:13.699830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:13.700405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:13.700499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:13.793253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:13.795409 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:13.930491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:14.029634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1042/2088] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:14.038598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.039314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.039526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.130842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:14.134168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:14.176708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1047/2089] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:14.182323 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.200820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f632b-f7ca-4ffe-93fe-9394cfc72d71 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.215172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.216235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.217683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.218002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.220339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:51:14.220671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.224784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.273560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1043/2090] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:51:14.275530 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.307288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2c309-1bec-4fb1-9d87-16fc2497d6c6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.338733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.340708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.341262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.342093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.343371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.372872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.387359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:14.473854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.474073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1048/2091] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:51:14 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:14.487103 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd5926-d752-47c4-ab7f-48aaae68a213 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.595766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.596841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.597387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.597824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.598720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.601391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.650293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1044/2092] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:51:14 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:14.651552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.666364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae9ec-5dc5-46cc-86a6-1699da32879e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.674659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.676494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.677408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.678043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.679536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.682605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.704127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1049/2093] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:51:14.708413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.728279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d8bb-b2a7-42d0-88ab-8b7b1a7eb37f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.742537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.745445 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.745780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.747762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.747762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.752588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537092ee-f5dc-4069-8e2d-12f00c5b209c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.779281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1045/2094] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:51:14.786299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:14.834154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222221ad-c1b0-4b3d-9e4e-97075fe2ddd7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:14.872197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:14.872819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.873104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.873485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] PATH_INFO: `/v3/projects/7e727831901d4f35911f2b27d5b69eae/users/bf0130d51e8a4346bdada040a682798e/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:14.902409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e727831901d4f35911f2b27d5b69eae, user_id=bf0130d51e8a4346bdada040a682798e, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:14.907382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:14.951958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1050/2095] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:14 2022] PUT /identity/v3/projects/7e727831901d4f35911f2b27d5b69eae/users/bf0130d51e8a4346bdada040a682798e/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:14.959320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1dc-e7c5-4030-bbf2-bc12496f0c39 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:14.959320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1dc-e7c5-4030-bbf2-bc12496f0c39 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:14.959320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1dc-e7c5-4030-bbf2-bc12496f0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:15.140542 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2d2bb1dc-e7c5-4030-bbf2-bc12496f0c39 None None] MFA Rules not processed for user `bf0130d51e8a4346bdada040a682798e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:15.142949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2d2bb1dc-e7c5-4030-bbf2-bc12496f0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:15.385898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1046/2096] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:15.422250 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:15.425101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:15.571352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68c23-4d0b-4459-83d6-d5bfecaa0fd2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:15.605486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:15.606262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:15.606547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:15.606830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:15.650595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:15.653321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319bbb2-d8e1-41a2-af75-b38ad864d528 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:15.679597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1051/2097] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:17.612403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:17.612968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:17.612968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:17.657079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] MFA Rules not processed for user `bf0130d51e8a4346bdada040a682798e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:17.658371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:17.688115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1047/2098] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:51:23.160330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36664a-35d6-48c0-8567-c95eea84a7ff None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:23.161497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36664a-35d6-48c0-8567-c95eea84a7ff None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:23.162015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36664a-35d6-48c0-8567-c95eea84a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:23.229975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3b36664a-35d6-48c0-8567-c95eea84a7ff None None] MFA Rules not processed for user `dd4bca8a3cfd4e9a9cc3aae67fbc1270`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:23.232126 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3b36664a-35d6-48c0-8567-c95eea84a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:23.403748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1052/2099] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:51:24.749729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:24.753739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:24.867573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:24.946666 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db9e42-7985-4df0-a463-4b22106bab24 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:24.957654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:24.958380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:24.958655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:24.959084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:24.961577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:25.105354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:25.108614 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:25.131560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1048/2100] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:25.424821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004ee5-bd8b-4c17-9ef8-24834348cee0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:25.425418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004ee5-bd8b-4c17-9ef8-24834348cee0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:25.425772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004ee5-bd8b-4c17-9ef8-24834348cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:25.459677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-4f004ee5-bd8b-4c17-9ef8-24834348cee0 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:25.461526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4f004ee5-bd8b-4c17-9ef8-24834348cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:25.530380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:25.594533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1053/2101] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:25.610289 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:25.611978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:25.759530 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08820368-b926-41fd-969f-a001c8799fd5 service glance] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:25.768728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:25.769832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:25.770457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:25.771163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:25.787094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:25.789640 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06964244-5763-4c35-a6ea-5cee7490372c service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:25.805200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1049/2102] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:51:35.576433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=8 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:35.801868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=68 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:37.137061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.137941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.138173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:37.140967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1054/2103] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:51:37.151306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad87-dddd-4994-8d84-e0c47fd5057c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.152319 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad87-dddd-4994-8d84-e0c47fd5057c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.152806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad87-dddd-4994-8d84-e0c47fd5057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:37.191977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7759ad87-dddd-4994-8d84-e0c47fd5057c None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:37.194892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7759ad87-dddd-4994-8d84-e0c47fd5057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:37.347898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1050/2104] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:51:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:37.378901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:37.384354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:37.464639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ef81-3b13-4179-b799-b1c37f8c9d19 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:37.479385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:37.480728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.481441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.482205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:37.508265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:37.514118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd36033-70f2-4755-a7d4-b9a9ef65abeb service glance] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:37.543316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1055/2105] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:37.708899 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.709200 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.709515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:37.711337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1051/2106] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:51:37.720441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97f63-6af1-4508-8e1a-bc457d1311f5 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.721247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97f63-6af1-4508-8e1a-bc457d1311f5 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.721974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97f63-6af1-4508-8e1a-bc457d1311f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:37.764273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-74c97f63-6af1-4508-8e1a-bc457d1311f5 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:37.770573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-74c97f63-6af1-4508-8e1a-bc457d1311f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:37.921115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:37.923432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1056/2107] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:51:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:37.935861 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:37.974954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488cc7f-9a54-4b03-a154-5eec329629d7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:37.983750 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:37.996691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:37.997038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:37.997321 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:38.030221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:38.036728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a10b2-71cd-45b4-ae45-b4e6dac0e05f service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:38.095618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1052/2108] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:51:38.277917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:38.279353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:38.281373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:38.289269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1057/2109] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:51:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:51:38.299078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:38.302850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:38.305560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:38.336814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:38.338205 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:38.359814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1053/2110] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:38.371982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:38.375193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:38.403195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501127-9a75-4ef4-a90e-1aedd82afb8e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:38.409715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:38.410859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:38.411341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:38.411845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:38.446752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:38.448944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:38.476245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1058/2111] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:51:40.192245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:40.195034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:40.415086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484c7c-492b-4aac-b89d-8e7d49ea4876 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:40.426802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:40.427768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:40.429729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:40.431560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:40.434735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:40.451672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:40.454802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff3452-ecde-4f1d-b9fa-60d432ad443f service placement] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:40.481018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1054/2112] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:40.651597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:40.656055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:40.771535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839564d-aaa0-4aa7-8f77-681cf01832ec service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:40.777675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:40.778862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:40.779642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:40.780179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] PATH_INFO: `/v3/users/ae9e111d5656491abc9a1d9374c70bec` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:40.783494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9e111d5656491abc9a1d9374c70bec)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:40.787244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:40.915230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9e111d5656491abc9a1d9374c70bec'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:40.931552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9e111d5656491abc9a1d9374c70bec'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:40.932426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9e111d5656491abc9a1d9374c70bec'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:40.933436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9e111d5656491abc9a1d9374c70bec'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:40.962882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9e111d5656491abc9a1d9374c70bec'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:41.010504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1059/2113] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:51:40 2022] DELETE /identity/v3/users/ae9e111d5656491abc9a1d9374c70bec => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:41.012651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210af1-5690-4230-a94e-295f38196d6b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:41.013510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210af1-5690-4230-a94e-295f38196d6b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:41.017368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210af1-5690-4230-a94e-295f38196d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:41.046951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-de210af1-5690-4230-a94e-295f38196d6b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:41.054433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-de210af1-5690-4230-a94e-295f38196d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:41.156313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1055/2114] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:51:41.172857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:41.174672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:41.182081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:41.259442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c2e1-af9d-4601-806d-c0cd850e019b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:41.263436 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:41.264123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:41.264402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:41.264670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:41.276933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:41.278459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:41.291086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1060/2115] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:41.418786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046851-9dfe-425d-8d47-31fb0547a075 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:41.419653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046851-9dfe-425d-8d47-31fb0547a075 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:41.419653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046851-9dfe-425d-8d47-31fb0547a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:41.437243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:41.461051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0e046851-9dfe-425d-8d47-31fb0547a075 None None] MFA Rules not processed for user `ed7ceabc060244609d195cd57313aabf`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:41.462872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0e046851-9dfe-425d-8d47-31fb0547a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:41.563195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1056/2116] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:42.024428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:42.025880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:42.041933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25614c0-12e1-4ae2-8c19-59bbcca268f7 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:42.048968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:42.050026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:42.050581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:42.051085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] PATH_INFO: `/v3/projects/ab7063f2fc7d46fe8238c3908e1fbfd7` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:42.052844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7063f2fc7d46fe8238c3908e1fbfd7)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:42.055265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:42.153733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7063f2fc7d46fe8238c3908e1fbfd7', 'request_id': 'req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:42.162576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7063f2fc7d46fe8238c3908e1fbfd7', 'request_id': 'req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:42.175747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7063f2fc7d46fe8238c3908e1fbfd7', 'request_id': 'req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:42.194249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] The token cache is being invalidate because project ab7063f2fc7d46fe8238c3908e1fbfd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:51:42.194591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:42.195245 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:42.197143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1061/2117] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:51:42 2022] DELETE /identity/v3/projects/ab7063f2fc7d46fe8238c3908e1fbfd7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:51:42.231079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fac4-b03f-41ee-bb6b-da8d26795ba6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:42.231412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fac4-b03f-41ee-bb6b-da8d26795ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:42.231619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fac4-b03f-41ee-bb6b-da8d26795ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:42.262316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-aec1fac4-b03f-41ee-bb6b-da8d26795ba6 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:42.265609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-aec1fac4-b03f-41ee-bb6b-da8d26795ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:42.401256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1057/2118] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:51:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:42.413022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:42.415947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:42.558129 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e9c5-dfdf-44a8-90b6-1e4fb939c94d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:42.567566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:42.568758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:42.569276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:42.569729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:42.585186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:42.589395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:42.622546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1062/2119] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:51:43.523003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7f2d-e286-433a-8597-339dea16f352 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:43.523935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7f2d-e286-433a-8597-339dea16f352 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:43.523935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7f2d-e286-433a-8597-339dea16f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:43.549070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7c4c7f2d-e286-433a-8597-339dea16f352 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:43.550236 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7c4c7f2d-e286-433a-8597-339dea16f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:43.558905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1058/2120] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:51:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:51:43.580259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:43.600013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9860f-6817-4ced-bdc7-b8e180dd78bd service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:43.612834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:43.613963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:43.614764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:43.615269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:43.628664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:43.632173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:43.645182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1063/2121] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:51:43.982913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67a8db-2358-4f15-8ab4-eed1de7f3b51 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:43.984483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67a8db-2358-4f15-8ab4-eed1de7f3b51 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:43.984952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67a8db-2358-4f15-8ab4-eed1de7f3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:44.008053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0b67a8db-2358-4f15-8ab4-eed1de7f3b51 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:44.009344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0b67a8db-2358-4f15-8ab4-eed1de7f3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:44.018518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1059/2122] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:51:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:44.037988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:44.050864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:44.060307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af28f-31be-4394-b338-e4ca67b4743d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:44.060650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af28f-31be-4394-b338-e4ca67b4743d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:44.061269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af28f-31be-4394-b338-e4ca67b4743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:44.061896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94c32-1e33-47c2-ad5e-91a30197db66 service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:44.074836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:44.075816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:44.076272 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:44.076724 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:44.091624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:44.095264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:44.098098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3a5af28f-31be-4394-b338-e4ca67b4743d None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:44.100193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3a5af28f-31be-4394-b338-e4ca67b4743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:44.107616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1064/2123] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:51:44.114697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1060/2124] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:51:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:44.137271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:44.151240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf601-2807-49a1-ae55-4f589510708e service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:44.157781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:44.159093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:44.159383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:44.159927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:44.171513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:44.174175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:44.191103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1065/2125] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:51:44.940863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:44.941672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:44.941831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:44.975156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:44.976461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:44.984420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1061/2126] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:51:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:45.017029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:45.036084 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ab2a-79c1-4d5b-94c0-8be49eb5e77d service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:45.042123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:45.042762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:45.043052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:45.043404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:45.054450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:45.056166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846d9a6-07f4-4ba2-883f-dc2d3de326be service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:45.070833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1066/2127] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:51:48.203991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:48.207896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:48.360264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675baf1-831a-42c2-a0de-59c446582938 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:48.369999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:48.371514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:48.372045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:48.372515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] PATH_INFO: `/v3/users/bf0130d51e8a4346bdada040a682798e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:48.374671 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0130d51e8a4346bdada040a682798e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:48.378172 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:48.442814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:48.484497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0130d51e8a4346bdada040a682798e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:48.531181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0130d51e8a4346bdada040a682798e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:48.532041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0130d51e8a4346bdada040a682798e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:48.532913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0130d51e8a4346bdada040a682798e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:48.576685 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0130d51e8a4346bdada040a682798e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:48.638286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1062/2128] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:51:48 2022] DELETE /identity/v3/users/bf0130d51e8a4346bdada040a682798e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:48.645198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:48.645916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:48.646187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:48.697729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:48.699828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:48.884014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1067/2129] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:48.900729 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:48.902726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:49.046093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b549f-c41c-4b13-989e-19995f6d3b53 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:49.054543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:49.057068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:49.057892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:49.058721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:49.080337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:49.083587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7ae31-01c7-4a7d-a055-ee41bd85e1bd service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:49.117293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1063/2130] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:49.476182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:49.479978 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:49.515944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5573733-0308-43c2-921f-b9ef0b4b3888 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:49.526790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:49.528291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:49.528832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:49.529410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] PATH_INFO: `/v3/projects/7e727831901d4f35911f2b27d5b69eae` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:49.532098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e727831901d4f35911f2b27d5b69eae)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:49.537453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:49.663565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e727831901d4f35911f2b27d5b69eae', 'request_id': 'req-ce0992dc-5f2e-4f71-9906-cf34aa157582'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:49.678092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e727831901d4f35911f2b27d5b69eae', 'request_id': 'req-ce0992dc-5f2e-4f71-9906-cf34aa157582'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:49.717360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e727831901d4f35911f2b27d5b69eae', 'request_id': 'req-ce0992dc-5f2e-4f71-9906-cf34aa157582'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:49.739300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] The token cache is being invalidate because project 7e727831901d4f35911f2b27d5b69eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:51:49.739721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:49.740672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce0992dc-5f2e-4f71-9906-cf34aa157582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:49.747146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1068/2131] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:51:49 2022] DELETE /identity/v3/projects/7e727831901d4f35911f2b27d5b69eae => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:49.749574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:49.750251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:49.750533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:49.788394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:49.790592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:49.976749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1064/2132] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:49.984087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:49.984500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:49.984891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.025718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:50.027898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:50.055909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1069/2133] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:50.058246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.086865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee501-68f5-4b34-b946-ae2228dd150c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.112904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.112904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.112904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.112904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.113647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:51:50.113647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.115005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.145622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1065/2134] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:51:50.150973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.188321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820538e-3d58-4ad5-bd41-048e60bf8fe9 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.194700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.195493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.195848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.196137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.196938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.199345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.260580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1070/2135] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:51:50 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:50.261310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.278234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323c25-a23e-4334-b934-e5429269ebad admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.383311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:50.458330 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.459454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.460122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.460631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.462071 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.469876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.537059 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1066/2136] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:51:50 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:50.538035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.565499 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f789e-2f05-48a2-873e-7b5ec76627dc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.575905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.577141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.577446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.577700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.578385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.580221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.597435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1071/2137] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:51:50.603896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.623652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488f04-b1b7-404b-977e-c8b61989d9cb admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.632342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.633510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.634066 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.634617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.635897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.639036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff666b-a126-4d3c-84a9-840b8c88d91f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.665764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1067/2138] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:50.667106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.684026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788431e-12b3-4bdc-bd47-b8d9d6c684c3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:50.690221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:50.691020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.691303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.691662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] PATH_INFO: `/v3/projects/0f7ef1548ead49f1958e4c629456a382/users/582e53acb83444bfbe748d35cc2d6670/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.702194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:50.749564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7ef1548ead49f1958e4c629456a382, user_id=582e53acb83444bfbe748d35cc2d6670, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:50.754093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:50.787961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1072/2139] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:50 2022] PUT /identity/v3/projects/0f7ef1548ead49f1958e4c629456a382/users/582e53acb83444bfbe748d35cc2d6670/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:51:50.803430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5d11-909d-448c-b53a-412dc9d3503b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:50.804502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5d11-909d-448c-b53a-412dc9d3503b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:50.804929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5d11-909d-448c-b53a-412dc9d3503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:50.844571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-490c5d11-909d-448c-b53a-412dc9d3503b None None] MFA Rules not processed for user `582e53acb83444bfbe748d35cc2d6670`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:50.849467 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-490c5d11-909d-448c-b53a-412dc9d3503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:50.943022 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1068/2140] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:51:50.957183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:50.966133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:51.087027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608e9b-fcee-4c50-acae-d2fe78095945 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:51.092797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:51.093576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:51.094201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:51.094479 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:51.107115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:51.108914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:51.121566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1073/2141] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:55.437855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:55.439019 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:55.439724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:55.481550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:55.483322 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:55.560536 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1069/2142] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:51:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:55.578687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:55.580804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:55.726686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f08ca9-c993-4da0-811f-d00449485107 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:55.743310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:55.745766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:55.746377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:55.747442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:55.775976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:55.780482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87c54-e9d7-452a-af14-c0090058a0cd service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:55.808784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1074/2143] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:51:56.146785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:56.318431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:56.389279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674949e-1ca1-4ad8-a6fd-9fa50d5af220 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:56.402451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:56.403128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:56.403466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:56.403802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] PATH_INFO: `/v3/users/582e53acb83444bfbe748d35cc2d6670` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:56.405161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=582e53acb83444bfbe748d35cc2d6670)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:56.407709 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:56.524158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582e53acb83444bfbe748d35cc2d6670'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:56.549040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582e53acb83444bfbe748d35cc2d6670'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:56.551126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582e53acb83444bfbe748d35cc2d6670'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:56.556651 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582e53acb83444bfbe748d35cc2d6670'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:56.582195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582e53acb83444bfbe748d35cc2d6670'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:56.624922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1070/2144] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:51:56 2022] DELETE /identity/v3/users/582e53acb83444bfbe748d35cc2d6670 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:56.630770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:56.631403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:56.631491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:56.682653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:56.686131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:56.923850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1075/2145] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:56.940154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:56.942678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:57.205477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2383-3b23-424b-b619-66e0dbdd27cd admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:57.226069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:57.226732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:57.227042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:57.227566 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:57.263162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:57.272572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04184-ff5e-4a67-9e84-a39c5fdd637f service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:57.307758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1071/2146] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:51:58.575568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:58.578138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:58.602431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34896e-7079-43e9-b1f9-755c75e3d28e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:58.618208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:58.618928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:58.619209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:58.619483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] PATH_INFO: `/v3/projects/0f7ef1548ead49f1958e4c629456a382` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:58.628737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7ef1548ead49f1958e4c629456a382)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:58.632318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:58.652293 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:58.744487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7ef1548ead49f1958e4c629456a382', 'request_id': 'req-ce05003e-3b3c-42ca-9925-47e765e1face'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:58.764140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7ef1548ead49f1958e4c629456a382', 'request_id': 'req-ce05003e-3b3c-42ca-9925-47e765e1face'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:58.781650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7ef1548ead49f1958e4c629456a382', 'request_id': 'req-ce05003e-3b3c-42ca-9925-47e765e1face'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:58.830918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] The token cache is being invalidate because project 0f7ef1548ead49f1958e4c629456a382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:51:58.833256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:58.837317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ce05003e-3b3c-42ca-9925-47e765e1face admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:51:58.842737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1076/2147] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:51:58 2022] DELETE /identity/v3/projects/0f7ef1548ead49f1958e4c629456a382 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:58.851061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aabe3-573b-412e-9235-410adc51d33e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:58.853438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aabe3-573b-412e-9235-410adc51d33e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:58.854195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aabe3-573b-412e-9235-410adc51d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:58.885423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-100aabe3-573b-412e-9235-410adc51d33e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:58.888102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-100aabe3-573b-412e-9235-410adc51d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:59.096555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1072/2148] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:59.165408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.165777 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.166063 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.190124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:51:59.191471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:51:59.220316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1077/2149] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:51:59.220947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100aabe3-573b-412e-9235-410adc51d33e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.235635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100aabe3-573b-412e-9235-410adc51d33e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.252689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.253339 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.258257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.258588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.259335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:51:59.259589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.261988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.296714 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:59.305944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1073/2150] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:51:59.309215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.337360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27824bb-ed0e-46b2-a3fe-6ef1e83ee25e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.342942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.344665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.348368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.348611 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.349391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.352218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.456248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1078/2151] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:51:59 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:59.457844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.470976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af357-908f-44ac-8a7a-a444cfa7f3a8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.575356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.576470 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.576902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.577521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.578717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.582159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.619918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1074/2152] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:51:59 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:51:59.622952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.665689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292290d-5fec-46d3-bd0b-229ee5a300ce admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.678727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.680959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.681849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.682680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.684415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.687856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.737378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1079/2153] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:59.743507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.756800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6a82-a369-4961-b6cc-d4e6225a7aa7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.765363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.766382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.767580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.768050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.768882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.771030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef72f-6aee-46d7-b7e4-e25bd202eb09 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.790668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1075/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:51:59.797078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:51:59.822233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284bef-6d9a-4790-ab35-2ee312998d7b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:51:59.833248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:51:59.835154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.836360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.836360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] PATH_INFO: `/v3/projects/319b1093dfbe4285a60c0aea1cd6a502/users/c569da95153a4e6093664db915b0c588/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:51:59.884199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b1093dfbe4285a60c0aea1cd6a502, user_id=c569da95153a4e6093664db915b0c588, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:51:59.889989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:51:59.961053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1080/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:51:59 2022] PUT /identity/v3/projects/319b1093dfbe4285a60c0aea1cd6a502/users/c569da95153a4e6093664db915b0c588/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:51:59.963733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f0c0-9995-4a1f-8c12-bba5a6cc7ccf None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:51:59.964380 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f0c0-9995-4a1f-8c12-bba5a6cc7ccf None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:51:59.964976 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f0c0-9995-4a1f-8c12-bba5a6cc7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:00.013992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f7e6f0c0-9995-4a1f-8c12-bba5a6cc7ccf None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:00.015335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f7e6f0c0-9995-4a1f-8c12-bba5a6cc7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:00.116190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1076/2156] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:52:00.129691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:00.132226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:00.284317 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116dcd-7e03-42ca-853e-3e8a8fd16dc9 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:00.305784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:00.307294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:00.307580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:00.308877 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:00.338938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:00.341379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:00.377174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1081/2157] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:52:08.440956 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4778f-6a9a-47dc-b3b1-da4080f7177e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:08.442641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4778f-6a9a-47dc-b3b1-da4080f7177e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:08.443374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4778f-6a9a-47dc-b3b1-da4080f7177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:08.477595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-fdd4778f-6a9a-47dc-b3b1-da4080f7177e None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:08.479292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fdd4778f-6a9a-47dc-b3b1-da4080f7177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:08.577770 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1077/2158] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:52:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:52:08.602905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:08.604470 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:08.666718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:08.706208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748bdd-37a6-42b3-8a27-14265c9019d9 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:08.712945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:08.713605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:08.713875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:08.714321 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:08.725988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:08.728687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:08.749955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1082/2159] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:52:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:52:08.992918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:08.993555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:08.994109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.102544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] MFA Rules not processed for user `c569da95153a4e6093664db915b0c588`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:09.104703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:09.133078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:09.301439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1078/2160] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:52:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:52:09.306092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.346190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4852a-b2d2-4cd3-b73f-4d135668d7c1 service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.359764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.361054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.361746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.362466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.364186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.369977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.439846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1083/2161] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:52:09 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:52:09.444303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.463611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4a5ac-6b70-4d51-8835-f19b7630725c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.595518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.596478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.596771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.597057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.597692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.600056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.629736 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1079/2162] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:52:09 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:52:09.631847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.653521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d06fc-88be-4e33-80c2-043291fb6146 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.659737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.660856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.661287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.661665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.662518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.664419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.682472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1084/2163] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:52:09.684164 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.698993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ea98-7853-4488-9171-98350f67062d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.705132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.705900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.706173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.706663 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] PATH_INFO: `/v3/projects/86580f588a82435ebed0c0204e931c43/users/7952455fd4614645b4c05cf7cfe703ed/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.732569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86580f588a82435ebed0c0204e931c43, user_id=7952455fd4614645b4c05cf7cfe703ed, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.735668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.755927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1080/2164] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:52:09 2022] PUT /identity/v3/projects/86580f588a82435ebed0c0204e931c43/users/7952455fd4614645b4c05cf7cfe703ed/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:52:09.761798 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.779009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3877-ea04-4d91-9e54-a3407aac84cc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.866015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.866712 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.866994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.867295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.868028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.869866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bb5f4-de08-4a6b-8c88-0b00430f335e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.884078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1085/2165] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:52:09.889888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:09.903407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235dfc2-0f11-4b1b-aa0f-48d273b96004 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:09.928348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:09.929401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:09.929763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:09.930052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] PATH_INFO: `/v3/projects/86580f588a82435ebed0c0204e931c43/users/7952455fd4614645b4c05cf7cfe703ed/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:09.933428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=86580f588a82435ebed0c0204e931c43, user_id=7952455fd4614645b4c05cf7cfe703ed, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:09.939749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:09.959863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1081/2166] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:52:09 2022] PUT /identity/v3/projects/86580f588a82435ebed0c0204e931c43/users/7952455fd4614645b4c05cf7cfe703ed/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:52:16.757718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad68d9-e575-45c0-94e5-46ddd204de51 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:16.758943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad68d9-e575-45c0-94e5-46ddd204de51 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:16.759939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad68d9-e575-45c0-94e5-46ddd204de51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:16.865011 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f7ad68d9-e575-45c0-94e5-46ddd204de51 None None] MFA Rules not processed for user `7952455fd4614645b4c05cf7cfe703ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:16.867224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f7ad68d9-e575-45c0-94e5-46ddd204de51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:16.989400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1086/2167] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:52:17.006661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:17.009607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:17.149465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:17.161342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf5bf3-5b9f-4999-bbd3-9c970778c4cb admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:17.172759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:17.173545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:17.173928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:17.174299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:17.265684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:17.268772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a4e71-fb85-4e25-8667-e020bd668dc9 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:17.289127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1082/2168] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:52:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:52:19.009674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:19.010261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:19.010659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:19.033169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] MFA Rules not processed for user `c569da95153a4e6093664db915b0c588`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:19.034783 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:19.042906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1087/2169] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:52:19.618859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:19.620097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:19.620528 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:19.681594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] MFA Rules not processed for user `dc57e9716aa849a9864745592e920c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:52:19.683878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:19.834978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1083/2170] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:52:23.071344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:23.075164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:23.119915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:23.261578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259eb11-9621-4266-98ef-ac79b01dcf9c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:23.270224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:23.271612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:23.279201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:23.280228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:23.285170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:52:23.396187 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:23.399380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadd7c0-6114-4d83-9a60-caf134d4d608 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:23.416839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1088/2171] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:52:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:52:29.820412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=52 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:33.410050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=45 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:47.309897 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:52:47.320299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a48c3-7c43-4ee3-b039-e3ce48e304fb None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:52:47.324257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:52:47.324892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:52:47.325152 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:52:47.325431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:52:47.336978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:52:47.339193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaf0ac-a8e1-48ed-a160-a3124e24e589 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:52:47.352955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1084/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:52:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:52:57.348050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=6 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:02.874054 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:02.876841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:02.877655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:02.918310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] MFA Rules not processed for user `e2e9bd7bd9384c079e8d4bcfadbf08a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:02.921532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:03.072059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1089/2173] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:05.170967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b0dc-3530-47ed-b715-d40094ea1129 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:05.171891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b0dc-3530-47ed-b715-d40094ea1129 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:05.171891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b0dc-3530-47ed-b715-d40094ea1129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:05.209250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-79b5b0dc-3530-47ed-b715-d40094ea1129 None None] MFA Rules not processed for user `e35bc05d950647809337ef28ab710e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:05.212338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-79b5b0dc-3530-47ed-b715-d40094ea1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:05.310058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1085/2174] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:13.036375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=25 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:15.301543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=25 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:34.583648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:34.598536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53976a3f-6dba-4f21-8751-fd070dedb7ff None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:34.604088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:34.604817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:34.605139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:34.605417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:34.607412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:34.689087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:34.690992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8860b-c5e1-4f79-85fd-768d5a53c80c service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:34.702398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1090/2175] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:53:38.381593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:38.383291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:38.383291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:38.384204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1086/2176] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:53:38.418569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:38.419194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:38.419194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:38.446391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] MFA Rules not processed for user `aef5b10788f64f30b4f45955e78b6618`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:38.447662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:38.457805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:38.460700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:38.481091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e366b5-fbe9-4296-9ec0-22ef82bb86be None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:38.486264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:38.487177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:38.487493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:38.487838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] PATH_INFO: `/v3/users/dc57e9716aa849a9864745592e920c69` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:38.489387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc57e9716aa849a9864745592e920c69)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:38.492133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:38.540501 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1091/2177] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:53:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:38.555442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:38.556851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:38.557592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc57e9716aa849a9864745592e920c69'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.567761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc57e9716aa849a9864745592e920c69'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.568719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc57e9716aa849a9864745592e920c69'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.569385 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc57e9716aa849a9864745592e920c69'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.570915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da69b-c588-4e80-87c9-95917f0d223e None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:38.577199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:38.577843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:38.578151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:38.578425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:38.580519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:38.580678 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc57e9716aa849a9864745592e920c69'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.595163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:38.598632 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4739-7306-4a6e-9cdc-d5f6f1fd4c54 service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:38.605579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1087/2178] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:53:38 2022] DELETE /identity/v3/users/dc57e9716aa849a9864745592e920c69 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:53:38.610668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1092/2179] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:53:38.824609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:38.826408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:38.909426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be8ec-ec6f-4daa-b665-fa51049a4dc6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:38.914548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:38.915203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:38.915476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:38.915751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] PATH_INFO: `/v3/projects/f71e22f02b0a41e9bbc171622626b681` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:38.917293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71e22f02b0a41e9bbc171622626b681)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:38.919231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:38.974010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71e22f02b0a41e9bbc171622626b681', 'request_id': 'req-b94e7965-832a-4051-875b-19d20377faed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.985010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71e22f02b0a41e9bbc171622626b681', 'request_id': 'req-b94e7965-832a-4051-875b-19d20377faed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:38.993154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71e22f02b0a41e9bbc171622626b681', 'request_id': 'req-b94e7965-832a-4051-875b-19d20377faed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:39.005805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] The token cache is being invalidate because project f71e22f02b0a41e9bbc171622626b681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:53:39.006057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:39.006789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-b94e7965-832a-4051-875b-19d20377faed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:53:39.008405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1088/2180] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:53:38 2022] DELETE /identity/v3/projects/f71e22f02b0a41e9bbc171622626b681 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:53:39.014067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.014427 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.014764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.044058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:39.045624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:39.140735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1093/2181] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:39.149382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.149659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.149929 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.160931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:39.178162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:39.179880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:39.201135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1089/2182] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:39.206492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.220236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462462c8-00dc-46dc-a90e-66a6272931b4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.233106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.234145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.234628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.235147 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.236300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:53:39.236917 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.240131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.257628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1094/2183] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:53:39.259742 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.270496 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63631f6-2a31-4eec-bbbd-407d54d3125d None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.276258 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.276980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.277429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.277574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.278293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.280503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.322439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1090/2184] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:53:39.324347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.331739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:39.336747 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295510-ca68-40de-b545-95cbcb6a7b8e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.407807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.408355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.408721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.409124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.409780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.411739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.436786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1095/2185] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:53:39.441254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.452946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559fe0-c9a9-4012-9e7a-259e4d08cf81 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.458541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.459155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.459430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.459693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.460379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.461991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.474126 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1091/2186] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:53:39.479468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.490485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa9434-363f-4fcc-b46b-23cdbe952f7d admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.496603 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.497252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.497531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.497805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.498485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.500194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3f9ba-9fd7-4182-8ae4-ed6e47c24f63 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.512448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1096/2187] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:53:39.517191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.529317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e86b2-c56d-470d-899a-e80a18bc6315 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.535220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.535986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.536263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.536534 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] PATH_INFO: `/v3/projects/a8deb6cb63f845b4add8524136f535e5/users/91a88382f8754914a3d934fe81b906bf/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.558076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8deb6cb63f845b4add8524136f535e5, user_id=91a88382f8754914a3d934fe81b906bf, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.562215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.581385 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1092/2188] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:53:39 2022] PUT /identity/v3/projects/a8deb6cb63f845b4add8524136f535e5/users/91a88382f8754914a3d934fe81b906bf/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:53:39.593383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.593664 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.593940 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.631482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] MFA Rules not processed for user `91a88382f8754914a3d934fe81b906bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:39.632754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:39.719186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1097/2189] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:39.724078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.796225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff93235-fa36-4449-96ed-8174c2167dac admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.802170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.802806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.803078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.803348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.804034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.806415 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.842282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1093/2190] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:53:39.843932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.861826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00e8ee-4d89-4a8e-8484-a43fbc566d5d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.926060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.926691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.926965 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.927234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.927905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.929858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.958013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1098/2191] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:53:39 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:53:39.964717 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:39.977046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29a0c-880b-4e65-a548-f3c4a41445b8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:39.981734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:39.982388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:39.982656 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:39.982919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:39.983587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:39.985223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:39.997273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1094/2192] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:53:40.002529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:40.011481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:40.019508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0778f-02aa-4c06-b134-f4958b097701 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:40.025955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:40.026659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.026946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.027214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] PATH_INFO: `/v3/projects/1728ac13c8f14471adb2740e3a1ceaff/users/eeac70f4d8954adf8c31712a6786906b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.046045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1728ac13c8f14471adb2740e3a1ceaff, user_id=eeac70f4d8954adf8c31712a6786906b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:40.049035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:40.067819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1099/2193] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:53:40 2022] PUT /identity/v3/projects/1728ac13c8f14471adb2740e3a1ceaff/users/eeac70f4d8954adf8c31712a6786906b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:53:40.072229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:40.084170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe420ab-0479-4e4e-9d01-1aaf60b34fed admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:40.147664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:40.148320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.148601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.148872 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.149514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:40.151145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590058a9-7671-4c5a-899b-563e3234ec01 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:40.162304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1095/2194] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:53:40.168613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:40.182368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868208d-2ae2-4aa1-b4cc-d2cbcd79e649 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:40.189188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:40.189868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.190149 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.190427 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] PATH_INFO: `/v3/projects/1728ac13c8f14471adb2740e3a1ceaff/users/eeac70f4d8954adf8c31712a6786906b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.193018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1728ac13c8f14471adb2740e3a1ceaff, user_id=eeac70f4d8954adf8c31712a6786906b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:40.195734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:40.208136 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1100/2195] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:53:40 2022] PUT /identity/v3/projects/1728ac13c8f14471adb2740e3a1ceaff/users/eeac70f4d8954adf8c31712a6786906b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:53:40.220674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.220965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.221266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.244890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:40.257144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] MFA Rules not processed for user `eeac70f4d8954adf8c31712a6786906b`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:53:40.259007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:40.358169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1096/2196] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:53:40.371540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:40.373687 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:40.441809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84c90-90b3-41a8-983d-8dfc5bde8114 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:40.446174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:40.446910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.447229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.447495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.457851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:40.459301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:40.469827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1101/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:53:40.564159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:40.574954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1b0c1-7d02-46ab-8c71-7ff01691e868 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:40.578886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:40.579622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:40.580062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:40.580308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:40.652613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:40.654087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:40.667054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1097/2198] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:53:50.465252 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:50.661178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=58 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:59.011262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:59.012951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:59.102193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b2fa2-0a54-4f72-aec9-f7f681dd8fa2 service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:59.108021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:59.108647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:59.108925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:59.109325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:59.111203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:59.179034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:59.180736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:59.193580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1102/2199] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:53:59.282182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:53:59.284689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:59.299085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce38c-e628-47fb-a952-c8c44501ac21 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:53:59.303637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:53:59.304329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:53:59.304609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:53:59.304880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:53:59.307199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:53:59.323401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:53:59.324981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:53:59.338855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1098/2200] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:01.833573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:01.836861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:01.900746 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648e19-684e-4d5a-bc1c-904cb2b194b2 service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:01.904507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:01.905182 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:01.905518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:01.905848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:01.907832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:01.922057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:01.923497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:01.934808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1103/2201] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:03.880268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:03.891978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b3aa4-ce32-4af0-9f15-ffb7e1af8503 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:03.897875 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:03.898558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:03.898922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:03.899256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:03.901121 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:03.964050 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:03.965741 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e6c32-3fe0-4395-8e6d-dff372929d59 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:03.976043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1099/2202] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:04.521367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:04.535871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b68da-4d7a-409b-850c-e75c018dc511 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:04.547601 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:04.548284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:04.548567 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:04.548839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:04.552259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:04.565004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:04.566453 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:04.578778 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1104/2203] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:11.682841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:11.683436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:11.683436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:11.691548 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:11.705858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:11.707266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:11.724612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:11.769667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9f5fb-1ba1-4945-a97c-530870660d91 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:11.775150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:11.775854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:11.776332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:11.776607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] PATH_INFO: `/v3/users/91a88382f8754914a3d934fe81b906bf` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:11.777904 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a88382f8754914a3d934fe81b906bf)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:11.779883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:11.783842 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1100/2204] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:11.841459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a88382f8754914a3d934fe81b906bf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:11.844029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:11.845943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:11.849815 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a88382f8754914a3d934fe81b906bf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:11.850542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a88382f8754914a3d934fe81b906bf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:11.851140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a88382f8754914a3d934fe81b906bf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:11.862109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-5b2fd841-20e2-4a8d-a676-82a74e4f23fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a88382f8754914a3d934fe81b906bf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:11.883482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1105/2205] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:11 2022] DELETE /identity/v3/users/91a88382f8754914a3d934fe81b906bf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:11.888068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:11.888357 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:11.888634 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:11.909946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:11.911190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:11.934094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de127-de23-42ac-b0d5-07e280da6179 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:11.977609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1106/2206] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:11.977866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:11.987834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:11.989291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:12.013840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:12.014546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:12.014892 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:12.015266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:12.017486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:12.046613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:12.053729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088481-9711-48c3-a0ea-a2a6f2e73798 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:12.058224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:12.058856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:12.059281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:12.059821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:12.069878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:12.071405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:12.081056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:12.081343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1107/2207] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:12.082657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:12.091134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1101/2208] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:54:12.370707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:12.372605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:12.388354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae003-6812-4b56-8996-5eeae2c4a75d service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:12.393743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:12.394678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:12.395270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:12.396122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] PATH_INFO: `/v3/projects/a8deb6cb63f845b4add8524136f535e5` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:12.398268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8deb6cb63f845b4add8524136f535e5)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:12.401744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:12.474886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8deb6cb63f845b4add8524136f535e5', 'request_id': 'req-29971ddd-1dad-417a-9249-18675fd0dbc9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.483389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8deb6cb63f845b4add8524136f535e5', 'request_id': 'req-29971ddd-1dad-417a-9249-18675fd0dbc9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.503758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8deb6cb63f845b4add8524136f535e5', 'request_id': 'req-29971ddd-1dad-417a-9249-18675fd0dbc9'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.523971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] The token cache is being invalidate because project a8deb6cb63f845b4add8524136f535e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:12.524500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.525608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.528924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1108/2209] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:12 2022] DELETE /identity/v3/projects/a8deb6cb63f845b4add8524136f535e5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:12.533596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:12.550155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2063e4-83b8-47a2-aa25-b103b70dfcf7 service swift] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:12.630558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:12.631817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:12.631817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:12.632038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] PATH_INFO: `/v3/users/eeac70f4d8954adf8c31712a6786906b` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:12.633472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeac70f4d8954adf8c31712a6786906b)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:12.635691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:12.711711 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeac70f4d8954adf8c31712a6786906b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.721500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeac70f4d8954adf8c31712a6786906b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.722230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeac70f4d8954adf8c31712a6786906b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.722828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeac70f4d8954adf8c31712a6786906b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.731830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-620d6c8e-6bbb-427b-ab0a-f6a7f7fbb594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeac70f4d8954adf8c31712a6786906b'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:12.744085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:12.755175 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1102/2210] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:12 2022] DELETE /identity/v3/users/eeac70f4d8954adf8c31712a6786906b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:13.123163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.125748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:13.148340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971ddd-1dad-417a-9249-18675fd0dbc9 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.234896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.235569 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.235884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.236159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] PATH_INFO: `/v3/projects/1728ac13c8f14471adb2740e3a1ceaff` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.237401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1728ac13c8f14471adb2740e3a1ceaff)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.239404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.300952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1728ac13c8f14471adb2740e3a1ceaff', 'request_id': 'req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:13.314345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1728ac13c8f14471adb2740e3a1ceaff', 'request_id': 'req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:13.328265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1728ac13c8f14471adb2740e3a1ceaff', 'request_id': 'req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:13.341350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] The token cache is being invalidate because project 1728ac13c8f14471adb2740e3a1ceaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:13.341774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:13.342454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-7ffbe02d-382c-4c65-b68a-17d0bbd0e4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:13.344559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1109/2211] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:13 2022] DELETE /identity/v3/projects/1728ac13c8f14471adb2740e3a1ceaff => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:13.349593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.349950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.350282 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.373818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:13.375098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:13.441983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1103/2212] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:13.451491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.451836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.452080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.461220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:13.479849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:13.481057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:13.491541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1110/2213] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:13.496529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.507780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73241-a0f5-426c-b74f-7ec091fc1f94 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.512933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.514017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.514017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.514211 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.514781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:13.515088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.517299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.532797 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1104/2214] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:13.537807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.549754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8519f-c5e8-404b-83c5-5ec80559f9c7 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.554429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.555112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.555355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.555582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.556260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.558327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.590975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1111/2215] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:13 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:13.595545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.608338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9faf39-5844-48ae-a0c9-d2c1252c1dfe admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.694854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.697036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.699278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.699486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.700207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.703109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.743341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.750524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1105/2216] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:13 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:13.757079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e7f26-241c-43f1-950d-0bffbed8ae54 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.765026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.765839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.766119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.766533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.767263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.769135 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.792735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.794620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1112/2217] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:13.806517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd87a13-03a1-4f82-b734-2d83608ee1ac admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.813805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.813805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.813805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.814479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.815148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.816812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170965-528b-45d7-8f8e-e9cdae584b25 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.834258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:13.835635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1106/2218] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:13.845760 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd33c-f6ef-4dd7-826b-fbd0979d6f27 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:13.850640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:13.851323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.851599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.851988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] PATH_INFO: `/v3/projects/fe54162aea9f43fa936a09b7f79efa32/users/7cfce0fbcb744551b900e8b98e93d42f/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.871532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe54162aea9f43fa936a09b7f79efa32, user_id=7cfce0fbcb744551b900e8b98e93d42f, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:13.874377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:13.898025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1113/2219] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:13 2022] PUT /identity/v3/projects/fe54162aea9f43fa936a09b7f79efa32/users/7cfce0fbcb744551b900e8b98e93d42f/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:13.908857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:13.909231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:13.909453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:13.948401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] MFA Rules not processed for user `7cfce0fbcb744551b900e8b98e93d42f`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:13.950340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:14.020830 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:14.043541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1107/2220] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:14.048421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.132025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4e06-7d35-4645-a446-a4201750a68a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.138482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.139300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.139984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.140491 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.143487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.146375 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.213212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1114/2221] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:14 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:14.217315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.247005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2753bc-7b4a-45ef-a27d-db5c105cd7b1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.439372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.440084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.440476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.440816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.441779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.444213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.477465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1108/2222] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:14 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:14.481730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.497353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a4e2-050c-4437-a578-46a97903e830 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.508819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.510267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.517163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.517930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.518966 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.524764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.561231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1115/2223] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:14.567356 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.583620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6eca-6ae1-435a-bcf5-703f25aa0ce7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.589343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.590400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.591388 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.591757 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] PATH_INFO: `/v3/projects/b7fac32d36434b21b60f86a56390250c/users/70770ac69a0e4544b8f182b1b7ca41f8/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.634684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fac32d36434b21b60f86a56390250c, user_id=70770ac69a0e4544b8f182b1b7ca41f8, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.651968 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.677124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1109/2224] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:14 2022] PUT /identity/v3/projects/b7fac32d36434b21b60f86a56390250c/users/70770ac69a0e4544b8f182b1b7ca41f8/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:14.678413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.692555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f43b8-223b-4bef-8c2a-392cb6c875d0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.775377 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.776075 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.776356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.776635 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.777308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.778939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb4140-69b6-4b57-8d97-d0f83deb6b45 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.795507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1116/2225] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:14.800049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:14.817047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70cac3-bd0b-4c8f-81f8-5de4cf0b979d admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:14.823503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:14.824238 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.824565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.825146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] PATH_INFO: `/v3/projects/b7fac32d36434b21b60f86a56390250c/users/70770ac69a0e4544b8f182b1b7ca41f8/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.827231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fac32d36434b21b60f86a56390250c, user_id=70770ac69a0e4544b8f182b1b7ca41f8, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:14.831212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:14.856686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1110/2226] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:14 2022] PUT /identity/v3/projects/b7fac32d36434b21b60f86a56390250c/users/70770ac69a0e4544b8f182b1b7ca41f8/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:14.858222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:14.858514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:14.858791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:14.891276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:14.917688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] MFA Rules not processed for user `70770ac69a0e4544b8f182b1b7ca41f8`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:14.919656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:15.056050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1117/2227] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:15.071633 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:15.073917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:15.218580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37db9-a511-4c62-ae26-0e5753cd898b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:15.224775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:15.225514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:15.225857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:15.226220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:15.243005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:15.246634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d63b-71a3-47e2-a861-18c3b0fcd7bb service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:15.269693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1111/2228] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:15.376833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:15.536305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca14d9-7b88-472c-ab6b-8a527a887313 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:15.545289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:15.546262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:15.546866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:15.547729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] PATH_INFO: `/v3/users/7cfce0fbcb744551b900e8b98e93d42f` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:15.551430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfce0fbcb744551b900e8b98e93d42f)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:15.554379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:15.577540 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:15.577876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:15.578155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:15.610219 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:15.611533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:15.675587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfce0fbcb744551b900e8b98e93d42f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:15.687421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:15.696463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfce0fbcb744551b900e8b98e93d42f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:15.700303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfce0fbcb744551b900e8b98e93d42f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:15.701043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfce0fbcb744551b900e8b98e93d42f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:15.723458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8685bb1b-4c21-4392-8c62-6d1da3783f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfce0fbcb744551b900e8b98e93d42f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:15.762932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1118/2229] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:15 2022] DELETE /identity/v3/users/7cfce0fbcb744551b900e8b98e93d42f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:15.763128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1112/2230] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:15.766376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:15.766663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:15.766942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:15.773877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:15.775521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:15.801326 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:15.802715 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:15.838794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:15.903696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6185d-12c0-4c3d-a0d7-c89690286c36 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:15.956483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1119/2231] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:15.965201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:15.970916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:16.032109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:16.036649 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:16.036997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:16.037320 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:16.091177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9477-a76f-4bec-a275-082a87971082 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:16.102391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:16.103168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:16.103443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:16.103800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:16.115210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:16.116742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:16.131606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1120/2232] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:16.150938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:16.152931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:16.178825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1113/2233] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:54:17.201946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:17.204620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:17.246682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ed3a-b18d-416a-b832-eac90c40fba1 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:17.280103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:17.281424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:17.282554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:17.282967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] PATH_INFO: `/v3/projects/fe54162aea9f43fa936a09b7f79efa32` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:17.285806 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe54162aea9f43fa936a09b7f79efa32)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:17.289657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:17.434871 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe54162aea9f43fa936a09b7f79efa32', 'request_id': 'req-10849be7-2780-4225-aacb-1e35bb3129d7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.454503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe54162aea9f43fa936a09b7f79efa32', 'request_id': 'req-10849be7-2780-4225-aacb-1e35bb3129d7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.477114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe54162aea9f43fa936a09b7f79efa32', 'request_id': 'req-10849be7-2780-4225-aacb-1e35bb3129d7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.500313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] The token cache is being invalidate because project fe54162aea9f43fa936a09b7f79efa32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:17.501872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.503906 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.510758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1121/2234] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:17 2022] DELETE /identity/v3/projects/fe54162aea9f43fa936a09b7f79efa32 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:17.512031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:17.524778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c675fc-82db-4dd2-9726-731972d75649 service swift] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:17.572561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:17.645049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:17.645732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:17.646040 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:17.646447 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] PATH_INFO: `/v3/users/70770ac69a0e4544b8f182b1b7ca41f8` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:17.652143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70770ac69a0e4544b8f182b1b7ca41f8)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:17.654466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:17.736045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70770ac69a0e4544b8f182b1b7ca41f8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.754336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70770ac69a0e4544b8f182b1b7ca41f8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.755850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70770ac69a0e4544b8f182b1b7ca41f8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.756625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70770ac69a0e4544b8f182b1b7ca41f8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.775132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-61620bdd-90ff-46cf-b3f2-9ceb99426fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70770ac69a0e4544b8f182b1b7ca41f8'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:17.804186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1114/2235] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:17 2022] DELETE /identity/v3/users/70770ac69a0e4544b8f182b1b7ca41f8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:18.670643 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:18.673828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:18.723703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849be7-2780-4225-aacb-1e35bb3129d7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:18.789714 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:18.821442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:18.821867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:18.822244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:18.822615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] PATH_INFO: `/v3/projects/b7fac32d36434b21b60f86a56390250c` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:18.824027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fac32d36434b21b60f86a56390250c)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:18.826137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:18.906773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fac32d36434b21b60f86a56390250c', 'request_id': 'req-0b961e86-b8ed-4ef8-a4f5-72928596eff7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:18.917328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fac32d36434b21b60f86a56390250c', 'request_id': 'req-0b961e86-b8ed-4ef8-a4f5-72928596eff7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:18.937705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fac32d36434b21b60f86a56390250c', 'request_id': 'req-0b961e86-b8ed-4ef8-a4f5-72928596eff7'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:18.957519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] The token cache is being invalidate because project b7fac32d36434b21b60f86a56390250c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:18.958073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:18.959088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0b961e86-b8ed-4ef8-a4f5-72928596eff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:18.966430 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1122/2236] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:18 2022] DELETE /identity/v3/projects/b7fac32d36434b21b60f86a56390250c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:18.967459 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:18.968494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:18.968836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:18.995713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:18.997682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:19.091881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1115/2237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:19.105817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.106140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.106370 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.131542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:19.133087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:19.152809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.153291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1123/2238] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:19.169525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270b81-3e34-4169-8470-06a4795035e0 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.177683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.178499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.178778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.179049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.179818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:19.180117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.181745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.209159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1116/2239] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:54:19.211559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.226463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28030b-6b21-464e-949e-6984a0184f6c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.239133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.239812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.240091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.240358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.241613 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.244055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.332423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1124/2240] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:19 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:19.336440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.360727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bf2b-67cf-4093-8c77-a9180c37d3a7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.504498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:19.576615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.577290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.577826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.578207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.579034 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.581359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.635122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1117/2241] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:19 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:19.636749 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.661046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f4c7-323d-47a0-bd1a-d7db7cd8191b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.673337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.674753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.675053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.675337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.677281 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.680563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.712232 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1125/2242] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:19.719201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.754466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbf0d-77d7-4502-a89f-5efc041d495a admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.762346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.763963 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.764426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.764853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.765718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.768784 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3759da2-55b1-4b03-80f4-f216eef6ef87 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.790177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1118/2243] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:19.794617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:19.808327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd910a6-30a4-4eab-8284-fc11f054359a admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:19.827498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:19.828382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.828659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.828923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] PATH_INFO: `/v3/projects/f6ac914fea6d435ca9ea512364fae37b/users/6b6a385e372b41068cf935986b48e906/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.877552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ac914fea6d435ca9ea512364fae37b, user_id=6b6a385e372b41068cf935986b48e906, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:19.881518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:19.929243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1126/2244] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:19 2022] PUT /identity/v3/projects/f6ac914fea6d435ca9ea512364fae37b/users/6b6a385e372b41068cf935986b48e906/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:19.931155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:19.931509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:19.931809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:19.994422 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] MFA Rules not processed for user `6b6a385e372b41068cf935986b48e906`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:19.998031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:20.197738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1119/2245] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:20.198156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:20.331132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972dc67-78f0-456f-b6ba-54144285a960 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:20.337422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:20.338237 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:20.338759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:20.339138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:20.339942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:20.342007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:20.355996 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:20.386302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1127/2246] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:20 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:20.388109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:20.400652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d86c5-b8d1-46d0-9a86-07af8083ce6a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:20.492828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:20.493933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:20.494311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:20.494669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:20.495689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:20.497818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:20.549909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1120/2247] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:20 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:20.553602 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:20.585262 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02e7e4-5b19-4c37-926b-a8302051c435 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:20.591155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:20.591941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:20.592140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:20.593269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:20.594284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:20.596597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:20.615303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1128/2248] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:20.615903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:20.631095 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7819-9fd8-4e8f-a6cb-ec84c6208ffa admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:20.639553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:20.640642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:20.660360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:20.660991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] PATH_INFO: `/v3/projects/37ff308f64a2473cab088bc71b9f2b00/users/d0d544a14be748219f8a54acc1aac94b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:20.698214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff308f64a2473cab088bc71b9f2b00, user_id=d0d544a14be748219f8a54acc1aac94b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:20.724967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:20.756500 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1121/2249] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:20 2022] PUT /identity/v3/projects/37ff308f64a2473cab088bc71b9f2b00/users/d0d544a14be748219f8a54acc1aac94b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:20.760680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:20.772399 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244d23-c338-4290-af36-46301d3f47e5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:20.962162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:20.963426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:20.963986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:20.964507 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:20.966628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:20.970595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9965-1c16-4d7e-9fc5-8d09f58db8b7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:21.006123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1129/2250] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:21.007858 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:21.022406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af56d-b9cb-4511-8c83-2bbc3bc4b7d1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:21.028845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:21.029587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:21.029955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:21.030235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] PATH_INFO: `/v3/projects/37ff308f64a2473cab088bc71b9f2b00/users/d0d544a14be748219f8a54acc1aac94b/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:21.033555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff308f64a2473cab088bc71b9f2b00, user_id=d0d544a14be748219f8a54acc1aac94b, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:21.036902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:21.048025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:21.056645 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1122/2251] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:21 2022] PUT /identity/v3/projects/37ff308f64a2473cab088bc71b9f2b00/users/d0d544a14be748219f8a54acc1aac94b/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:21.072401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:21.072401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:21.073348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:21.146756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] MFA Rules not processed for user `d0d544a14be748219f8a54acc1aac94b`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:21.148171 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:21.269445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1130/2252] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:21.285738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:21.288508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:21.425444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5561-f5d1-4c79-a973-533999e38ce7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:21.434972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:21.435513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:21.435913 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:21.436194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:21.455156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:21.456868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:21.472390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1123/2253] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:22.068324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:22.095040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7f5e7-3f69-4189-ac63-a6a9d2db189f None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:22.121837 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d544a14be748219f8a54acc1aac94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ff308f64a2473cab088bc71b9f2b00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:22.122509 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:22.122772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:22.123219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:22.124101 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:22.124692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:22.126513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:22.160959 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1131/2254] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:22.165618 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:22.180320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:22.182422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:22.199215 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf236-05cf-47b1-bda6-a268c29da56b service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:22.215368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d544a14be748219f8a54acc1aac94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ff308f64a2473cab088bc71b9f2b00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:22.216210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:22.216597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:22.216971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:22.217727 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:22.220488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:22.263860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:22.274938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5939c9-fed1-447c-b125-9c9325247d82 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:22.282575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:22.283768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:22.284249 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:22.284840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:22.287301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:22.318003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1124/2255] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:22 2022] POST /identity/v3/projects => generated 354 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:22.324253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:22.402067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:22.403716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:22.423081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1132/2256] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:22.479511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf324-547f-4960-93b2-f174c4edba85 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:22.488271 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d544a14be748219f8a54acc1aac94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ff308f64a2473cab088bc71b9f2b00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:22.489011 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:22.489307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:22.489586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:22.491602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:22.492816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:22.495718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:22.519096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1125/2257] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:22.588902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:22.600845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28821-7566-4e99-86d1-e509048c216e service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:22.606140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d544a14be748219f8a54acc1aac94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37ff308f64a2473cab088bc71b9f2b00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:22.607055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:22.607483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:22.608048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] PATH_INFO: `/v3/projects/09b34e2a56fb453fa5851c66d6404c1f` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:22.609647 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09b34e2a56fb453fa5851c66d6404c1f)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:22.611970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:22.766883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b34e2a56fb453fa5851c66d6404c1f', 'request_id': 'req-e59772a2-3825-4446-a760-f8308d8635bb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:22.799843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b34e2a56fb453fa5851c66d6404c1f', 'request_id': 'req-e59772a2-3825-4446-a760-f8308d8635bb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:22.813823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b34e2a56fb453fa5851c66d6404c1f', 'request_id': 'req-e59772a2-3825-4446-a760-f8308d8635bb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:22.838085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] The token cache is being invalidate because project 09b34e2a56fb453fa5851c66d6404c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:22.838891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:22.839905 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e59772a2-3825-4446-a760-f8308d8635bb tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:22.841742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1133/2258] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:22 2022] DELETE /identity/v3/projects/09b34e2a56fb453fa5851c66d6404c1f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:23.261615 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:23.264008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:23.400283 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffa5ed-a6fe-4daa-b3dd-182d97fefa05 tempest-VolumeQuotaClassesTest-460254827 tempest-VolumeQuotaClassesTest-460254827-project-admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:23.423325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:23.485919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:23.487424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:23.487994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:23.488452 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] PATH_INFO: `/v3/users/6b6a385e372b41068cf935986b48e906` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:23.490519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6a385e372b41068cf935986b48e906)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:23.492777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:23.641543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6a385e372b41068cf935986b48e906'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:23.650807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6a385e372b41068cf935986b48e906'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:23.651538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6a385e372b41068cf935986b48e906'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:23.652169 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6a385e372b41068cf935986b48e906'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:23.678174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6a385e372b41068cf935986b48e906'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:23.740353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1126/2259] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:23 2022] DELETE /identity/v3/users/6b6a385e372b41068cf935986b48e906 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:23.745405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:23.745962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:23.745962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:23.776213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:23.778418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:23.941469 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1134/2260] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:23.962012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:23.963487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:24.109098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305ea5-14ab-4017-bb34-0ae5a210cb80 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:24.121221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:24.121943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:24.122134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:24.122400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:24.147569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:24.152072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:24.166004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1127/2261] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:24.311669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:24.314022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:24.337291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d459a5-bed1-4d49-ad05-3511993ab938 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:24.355306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:24.356331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:24.356974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:24.357268 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] PATH_INFO: `/v3/users/ed7ceabc060244609d195cd57313aabf` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:24.358761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7ceabc060244609d195cd57313aabf)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:24.361546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:24.386703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:24.463741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7ceabc060244609d195cd57313aabf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:24.476892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7ceabc060244609d195cd57313aabf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:24.478062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7ceabc060244609d195cd57313aabf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:24.478804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7ceabc060244609d195cd57313aabf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:24.493078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7ceabc060244609d195cd57313aabf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:24.517505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1135/2262] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:24 2022] DELETE /identity/v3/users/ed7ceabc060244609d195cd57313aabf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:24.829774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:24.839804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36f7f-9999-443a-a670-909664fb31f9 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:24.975641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:25.013136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:25.013945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:25.014424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:25.018902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] PATH_INFO: `/v3/projects/b5894afcd8e44031a855a39f937a076e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:25.020105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5894afcd8e44031a855a39f937a076e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:25.023996 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:25.156162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:25.157788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:25.165025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5894afcd8e44031a855a39f937a076e', 'request_id': 'req-8c386e6c-7173-49a4-a69b-aea6d5ecb521'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.190346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5894afcd8e44031a855a39f937a076e', 'request_id': 'req-8c386e6c-7173-49a4-a69b-aea6d5ecb521'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.203347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2402-140d-49c1-a1ae-c06084ca0f60 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:25.208501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5894afcd8e44031a855a39f937a076e', 'request_id': 'req-8c386e6c-7173-49a4-a69b-aea6d5ecb521'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.245747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] The token cache is being invalidate because project b5894afcd8e44031a855a39f937a076e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:25.247780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.250572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.255110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1128/2263] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:24 2022] DELETE /identity/v3/projects/b5894afcd8e44031a855a39f937a076e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:25.259767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:25.268879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:25.443824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:25.445989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:25.446284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:25.447180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] PATH_INFO: `/v3/projects/f6ac914fea6d435ca9ea512364fae37b` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:25.449920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ac914fea6d435ca9ea512364fae37b)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:25.454953 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:25.482183 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386e6c-7173-49a4-a69b-aea6d5ecb521 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:25.487308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:25.488220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:25.488642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:25.488914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] PATH_INFO: `/v3/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:25.490093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4bca8a3cfd4e9a9cc3aae67fbc1270)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:25.492328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:25.579604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ac914fea6d435ca9ea512364fae37b', 'request_id': 'req-c98dda12-2da6-4164-92fc-016e6854ba85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.591497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4bca8a3cfd4e9a9cc3aae67fbc1270'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.604533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ac914fea6d435ca9ea512364fae37b', 'request_id': 'req-c98dda12-2da6-4164-92fc-016e6854ba85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.618895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4bca8a3cfd4e9a9cc3aae67fbc1270'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.622127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4bca8a3cfd4e9a9cc3aae67fbc1270'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.624737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4bca8a3cfd4e9a9cc3aae67fbc1270'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.631981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ac914fea6d435ca9ea512364fae37b', 'request_id': 'req-c98dda12-2da6-4164-92fc-016e6854ba85'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.652303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4bca8a3cfd4e9a9cc3aae67fbc1270'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.667026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] The token cache is being invalidate because project f6ac914fea6d435ca9ea512364fae37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:25.667322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.671229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:25.678431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1136/2264] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:25 2022] DELETE /identity/v3/projects/f6ac914fea6d435ca9ea512364fae37b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:25.682215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:25.685158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:25.691260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:25.713880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1129/2265] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:25 2022] DELETE /identity/v3/users/dd4bca8a3cfd4e9a9cc3aae67fbc1270 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:25.740767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:25.797279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dda12-2da6-4164-92fc-016e6854ba85 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:25.891409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:25.892363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:25.892828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:25.893266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] PATH_INFO: `/v3/users/d0d544a14be748219f8a54acc1aac94b` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:25.894813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d544a14be748219f8a54acc1aac94b)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:25.898322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:26.010923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d544a14be748219f8a54acc1aac94b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.033177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d544a14be748219f8a54acc1aac94b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.034117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d544a14be748219f8a54acc1aac94b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.037395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d544a14be748219f8a54acc1aac94b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.057693 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d544a14be748219f8a54acc1aac94b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.116833 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1137/2266] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:25 2022] DELETE /identity/v3/users/d0d544a14be748219f8a54acc1aac94b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:26.161555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:26.164710 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:26.193046 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a838-9a54-4973-880a-0450fb1bc77a admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:26.366372 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:26.367461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:26.369157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:26.369157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] PATH_INFO: `/v3/projects/cee8613516974c61885373bc97a28e2d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:26.370031 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee8613516974c61885373bc97a28e2d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:26.373522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:26.458472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee8613516974c61885373bc97a28e2d', 'request_id': 'req-67a17a9d-5633-4325-ac17-822d1abdba23'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.508049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee8613516974c61885373bc97a28e2d', 'request_id': 'req-67a17a9d-5633-4325-ac17-822d1abdba23'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.525133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee8613516974c61885373bc97a28e2d', 'request_id': 'req-67a17a9d-5633-4325-ac17-822d1abdba23'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.545494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] The token cache is being invalidate because project cee8613516974c61885373bc97a28e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:26.545901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.546664 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-67a17a9d-5633-4325-ac17-822d1abdba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:26.559825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1130/2267] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:26 2022] DELETE /identity/v3/projects/cee8613516974c61885373bc97a28e2d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:26.790032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:26.817544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:26.856445 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18955-09e0-4bb6-83d3-1737f9b191ce admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:26.953822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:26.968855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:26.970325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:26.970610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:26.970969 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] PATH_INFO: `/v3/projects/37ff308f64a2473cab088bc71b9f2b00` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:26.973000 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ff308f64a2473cab088bc71b9f2b00)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:26.975396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.035145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ff308f64a2473cab088bc71b9f2b00', 'request_id': 'req-a531c54a-040b-4bcc-a131-20f8419f2b61'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:27.048750 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ff308f64a2473cab088bc71b9f2b00', 'request_id': 'req-a531c54a-040b-4bcc-a131-20f8419f2b61'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:27.065810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ff308f64a2473cab088bc71b9f2b00', 'request_id': 'req-a531c54a-040b-4bcc-a131-20f8419f2b61'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:27.079193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] The token cache is being invalidate because project 37ff308f64a2473cab088bc71b9f2b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:27.082706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:27.083473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a531c54a-040b-4bcc-a131-20f8419f2b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:27.085418 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1138/2268] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:26 2022] DELETE /identity/v3/projects/37ff308f64a2473cab088bc71b9f2b00 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:27.092297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.093072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.093518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.122802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:27.124549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:27.238911 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1131/2269] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:27.241145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.241614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.242164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.304004 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:27.305350 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:27.316300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1139/2270] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:27.321681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:27.336721 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c17608-24f6-4814-a2ef-0ddaeb7c0e95 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:27.343311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:27.344382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.344763 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.345137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.346756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:27.347177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:27.349054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.378442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1132/2271] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:27.384466 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:27.397679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b339158-0dcd-48e2-a0c3-d16314e95cf6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:27.414505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:27.415600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.416143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.416720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.417862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:27.422351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.560962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1140/2272] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:27 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:27.565089 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:27.583767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d069e-9d74-4b89-ac8f-177e73e02317 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:27.605867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:27.753737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:27.754405 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.754680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.754954 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.758817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:27.767088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.826145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1133/2273] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:27 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:27.826381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:27.857487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2ef3-fc00-4654-9917-a698a853f943 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:27.864653 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:27.865314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.865655 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.865912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.866556 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:27.869154 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.891922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1141/2274] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:27.897708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:27.918944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c976705-9dce-4134-8dfc-cde14997d0e7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:27.936028 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:27.937179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:27.937713 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:27.938176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:27.938969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:27.941269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca437a-2fdf-4a33-8c04-5ebbfa06814c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:27.977401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1134/2275] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:27.982484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.007987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e2f1-a739-4ec9-96ab-fb908a47e3aa admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.024037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.024037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.024037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.024690 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] PATH_INFO: `/v3/projects/504a613bb92242cbb7803b7742f770f0/users/aab20295e34e4508b92910ae31472ffb/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.086951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504a613bb92242cbb7803b7742f770f0, user_id=aab20295e34e4508b92910ae31472ffb, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.100560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.148577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.149058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.149320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1142/2276] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:27 2022] PUT /identity/v3/projects/504a613bb92242cbb7803b7742f770f0/users/aab20295e34e4508b92910ae31472ffb/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:28.149573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.197342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] MFA Rules not processed for user `aab20295e34e4508b92910ae31472ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:28.198782 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:28.363922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1135/2277] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:28.368133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.475780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.477404 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:28.516119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba8d0-abba-4f35-87b8-c3df4c0c42e6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.521686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.522702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.523159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.523576 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.524511 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.528363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.575050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1143/2278] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:28 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:28.580467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.582571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96f698-124a-489f-86ff-96d9b750a101 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.586967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:28.633513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:28.696194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.696947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.697269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.697575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] PATH_INFO: `/v3/users/e2e9bd7bd9384c079e8d4bcfadbf08a4` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.699086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e9bd7bd9384c079e8d4bcfadbf08a4)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.699256 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2a4c-edc8-4402-94cb-f35337b13a97 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.701098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.704684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.705832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.706119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.706394 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.707064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.710208 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.751156 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1144/2279] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:28 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:28.758067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.774060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215950aa-ffea-47ad-903a-30ac32f19215 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.776248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e9bd7bd9384c079e8d4bcfadbf08a4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:28.784041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.785203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.785203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.785431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.786047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e9bd7bd9384c079e8d4bcfadbf08a4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:28.787452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.787722 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e9bd7bd9384c079e8d4bcfadbf08a4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:28.788519 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e9bd7bd9384c079e8d4bcfadbf08a4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:28.789796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.801867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e9bd7bd9384c079e8d4bcfadbf08a4'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:28.805962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1145/2280] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:28.810584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:28.815148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:28.827207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1136/2281] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:28 2022] DELETE /identity/v3/users/e2e9bd7bd9384c079e8d4bcfadbf08a4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:28.841164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf91b5-a868-40f3-a44b-fe134d049e68 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:28.926134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:28.927868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:28.928455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:28.929351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] PATH_INFO: `/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d/users/c9eb7098ba2c4bd79d20c939b7e04358/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:28.954354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe3b7441fe478f85f217b9e389ee7d, user_id=c9eb7098ba2c4bd79d20c939b7e04358, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:28.957620 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:28.980896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1146/2282] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:28 2022] PUT /identity/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d/users/c9eb7098ba2c4bd79d20c939b7e04358/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:28.984912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.002462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0030e0d-e59b-4ca1-9d80-1614e25d19c9 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.046682 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.049893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.143970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.144603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.144882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.145155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.145808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.147700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.171870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248794a5-8450-4d9b-bcb8-1e2c3ff63e12 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.172162 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1137/2283] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:29.174738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.185412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.186518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.186810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.187087 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] PATH_INFO: `/v3/projects/2219120272eb4760b5ec37a735ecaa53` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.188396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2219120272eb4760b5ec37a735ecaa53)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.192973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.206453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802e7c5-4200-4c96-af74-da1d82b3f314 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.213900 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.214595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.214866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.215145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] PATH_INFO: `/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d/users/c9eb7098ba2c4bd79d20c939b7e04358/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.217190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe3b7441fe478f85f217b9e389ee7d, user_id=c9eb7098ba2c4bd79d20c939b7e04358, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.219639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:29.220186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7741-ca62-43b3-be2a-bcd905fb0d4e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.244220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1138/2284] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:29 2022] PUT /identity/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d/users/c9eb7098ba2c4bd79d20c939b7e04358/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:29.246351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.246635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.246915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.303811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] MFA Rules not processed for user `c9eb7098ba2c4bd79d20c939b7e04358`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:29.305098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.328772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2219120272eb4760b5ec37a735ecaa53', 'request_id': 'req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:29.339698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:29.344131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2219120272eb4760b5ec37a735ecaa53', 'request_id': 'req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:29.357610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2219120272eb4760b5ec37a735ecaa53', 'request_id': 'req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:29.396730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] The token cache is being invalidate because project 2219120272eb4760b5ec37a735ecaa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:29.396730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:29.397836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-30ffde58-0fe0-4d4f-a015-ccbbf9846fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:29.399821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1147/2285] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:29 2022] DELETE /identity/v3/projects/2219120272eb4760b5ec37a735ecaa53 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:29.405521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26ad57-e707-4b0c-8c54-a1f6ee886978 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.405854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26ad57-e707-4b0c-8c54-a1f6ee886978 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.406227 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26ad57-e707-4b0c-8c54-a1f6ee886978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.430868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-8e26ad57-e707-4b0c-8c54-a1f6ee886978 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:29.432395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-8e26ad57-e707-4b0c-8c54-a1f6ee886978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.441977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1139/2286] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:29.464546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.466755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.571589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1148/2287] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:29.573790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.574188 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.574565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.602160 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a230-cebf-490b-ba1e-d3538f4e3087 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.602389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:29.602762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.611278 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1149/2288] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:29.612230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.612883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.613242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.613479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.616029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.628008 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5fbf1-aea2-448b-a8d4-6c7cf790b258 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.633070 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.633809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.634185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.634555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.637216 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:29.637639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.641469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.642068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.643325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.659211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1150/2289] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:54:29.662769 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.667186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1140/2290] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:29.674105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528eb4-f1e2-4dec-bc35-243bda756a6b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.684841 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.685625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.686003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.686487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.687242 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.690095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.731296 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1151/2291] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:29 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:29.735609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.748934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33fbc-9141-4da5-89bb-fc5180e4a3e3 service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.778247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.822788 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.823613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.824276 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.824670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.825423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.828487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.861580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1141/2292] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:29 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:29.865533 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.869708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f5a0-b6d5-4e59-adff-1f4114f3fa8b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.878158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.878836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.879120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.879393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.881690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e3faf-d293-4431-ae74-b40127055a6c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.881830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:29.887098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.888333 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.888929 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:29.890085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.890549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.894716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.897290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.920557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1142/2293] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:29.922080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.935312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e74ed-e24f-4329-955c-5e5fa1bc4666 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.942414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.943680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.944157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.945622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:29.946471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.949353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.968639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1143/2294] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:29.969548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:29.981046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:29.982788 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ce27-c4d7-45e4-bb1f-26b815a57d9d service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:29.984156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29044a06-0aca-4946-8999-f4cd5452d7cf admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:29.991363 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:29.992908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:29.993371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:29.993802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] PATH_INFO: `/v3/projects/0656d95f47824bfa89c2dd1ccbc91cce/users/789019238c674e5288cd2770dc75ad97/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:30.008631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1152/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:30.014381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0656d95f47824bfa89c2dd1ccbc91cce, user_id=789019238c674e5288cd2770dc75ad97, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:30.018104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:30.033776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:30.048758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1144/2296] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:29 2022] PUT /identity/v3/projects/0656d95f47824bfa89c2dd1ccbc91cce/users/789019238c674e5288cd2770dc75ad97/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:30.050271 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:30.050773 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:30.051074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:30.088122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:30.089743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:30.180068 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1153/2297] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:30.187427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:30.189348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:30.287980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60b5c-6859-4a3b-a274-701a22c9cb05 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:30.293648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:30.294596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:30.295366 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:30.295778 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:30.320314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:30.323049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db100b13-b980-4564-a469-bd7f6ff3999c service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:30.344525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1145/2298] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:35.937878 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:35.940048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:35.957369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fd03-efc1-4842-840f-d36955a01311 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:35.963106 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:35.963766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:35.965898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:35.966186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] PATH_INFO: `/v3/users/aab20295e34e4508b92910ae31472ffb` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:35.972159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab20295e34e4508b92910ae31472ffb)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:35.974160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:36.069306 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab20295e34e4508b92910ae31472ffb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:36.079140 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab20295e34e4508b92910ae31472ffb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:36.080178 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab20295e34e4508b92910ae31472ffb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:36.080976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab20295e34e4508b92910ae31472ffb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:36.096622 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab20295e34e4508b92910ae31472ffb'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:36.141821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1154/2299] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:35 2022] DELETE /identity/v3/users/aab20295e34e4508b92910ae31472ffb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:36.142584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c0c2c-8f28-420c-aa33-d23fa008ad1e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.143045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c0c2c-8f28-420c-aa33-d23fa008ad1e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.143140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c0c2c-8f28-420c-aa33-d23fa008ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.172957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-631c0c2c-8f28-420c-aa33-d23fa008ad1e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:36.174658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-631c0c2c-8f28-420c-aa33-d23fa008ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.299845 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1146/2300] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:36.314745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:36.316626 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.357141 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:36.425351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ac6a-cb96-422d-9c0b-297a59ff6aa0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:36.430072 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:36.430802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.431185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.431529 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.442766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:36.444505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:36.458287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1155/2301] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:36.516785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.517313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.517762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.565116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] MFA Rules not processed for user `789019238c674e5288cd2770dc75ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:36.566908 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.683177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1147/2302] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:36.694564 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:36.696174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.858170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cff5-cf24-4b50-91df-b04d790b916e service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:36.866608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:36.867331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.867584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.867897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.883269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:36.886666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:36.900955 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:36.905155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.921835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1156/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:36.948575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:36.951821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.971376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489afc-3740-4546-8927-28aaaea9c491 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:36.980419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1806b3a-e03e-434b-952e-0783593256e6 service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:36.984698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:36.985623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.986110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.986550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.986795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:36.987535 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:36.987928 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:36.988267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] PATH_INFO: `/v3/projects/504a613bb92242cbb7803b7742f770f0` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:36.989662 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:36.991886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] RBAC: Authorizing `identity:delete_project(project_id=504a613bb92242cbb7803b7742f770f0)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:36.994263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:37.015512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:37.019309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:37.060129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1148/2304] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:37.124132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504a613bb92242cbb7803b7742f770f0', 'request_id': 'req-062d908b-2cf3-4145-8a96-6fa8e251485b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.133555 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504a613bb92242cbb7803b7742f770f0', 'request_id': 'req-062d908b-2cf3-4145-8a96-6fa8e251485b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.153144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504a613bb92242cbb7803b7742f770f0', 'request_id': 'req-062d908b-2cf3-4145-8a96-6fa8e251485b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.176759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] The token cache is being invalidate because project 504a613bb92242cbb7803b7742f770f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:37.177320 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.178238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.180568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1157/2305] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:36 2022] DELETE /identity/v3/projects/504a613bb92242cbb7803b7742f770f0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:37.185130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:37.200290 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70db91e-9f42-4787-b376-4143559e994a service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:37.224735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:37.287337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:37.288458 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:37.288780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:37.289060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] PATH_INFO: `/v3/users/c9eb7098ba2c4bd79d20c939b7e04358` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:37.290325 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9eb7098ba2c4bd79d20c939b7e04358)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:37.310042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:37.398681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9eb7098ba2c4bd79d20c939b7e04358'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.410207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9eb7098ba2c4bd79d20c939b7e04358'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.411379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9eb7098ba2c4bd79d20c939b7e04358'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.412266 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9eb7098ba2c4bd79d20c939b7e04358'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.425964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9eb7098ba2c4bd79d20c939b7e04358'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:37.453751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1149/2306] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:37 2022] DELETE /identity/v3/users/c9eb7098ba2c4bd79d20c939b7e04358 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:37.651606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:37.654733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:37.704623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:37.750494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d908b-2cf3-4145-8a96-6fa8e251485b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:37.832694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:37.833452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:37.833743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:37.834003 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:37.836334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:37.850042 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:37.852593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:37.854948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:37.857164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7940-09ea-49cb-8c18-34b69cc42ac3 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:37.875439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1158/2307] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:37.968482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39763-4d98-496c-924e-7ba0d6fe8405 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:37.976781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:37.977620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:37.978074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:37.978392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] PATH_INFO: `/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:37.979940 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfe3b7441fe478f85f217b9e389ee7d)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:37.982204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.043569 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:38.052369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfe3b7441fe478f85f217b9e389ee7d', 'request_id': 'req-002eb795-2a3d-4565-90bc-f1231040bf75'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:38.065669 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfe3b7441fe478f85f217b9e389ee7d', 'request_id': 'req-002eb795-2a3d-4565-90bc-f1231040bf75'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:38.080438 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfe3b7441fe478f85f217b9e389ee7d', 'request_id': 'req-002eb795-2a3d-4565-90bc-f1231040bf75'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:38.096858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365581-f756-4d35-8f6a-1ac470792339 None None] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.097472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365581-f756-4d35-8f6a-1ac470792339 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.097579 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365581-f756-4d35-8f6a-1ac470792339 None None] PATH_INFO: `/` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.099044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1159/2308] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 13:54:38.103102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] The token cache is being invalidate because project 3dfe3b7441fe478f85f217b9e389ee7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:38.103392 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:38.104427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-002eb795-2a3d-4565-90bc-f1231040bf75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:38.105619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.106202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.106316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1150/2309] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:37 2022] DELETE /identity/v3/projects/3dfe3b7441fe478f85f217b9e389ee7d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:38.106409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.112116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24b88-3104-4869-bf3b-969724298d9e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.112318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24b88-3104-4869-bf3b-969724298d9e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.112570 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24b88-3104-4869-bf3b-969724298d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.135951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:38.137330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.150679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-43a24b88-3104-4869-bf3b-969724298d9e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:38.152708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-43a24b88-3104-4869-bf3b-969724298d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.253133 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1160/2310] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:38.262400 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1151/2311] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:38.270640 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.271342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.271703 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.272027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.272623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.323509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:38.326979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.351971 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1152/2312] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:38.354294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.371507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015567db-dafd-4e21-ac4c-31136089c9fe None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.376923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.377595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.377959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.378229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.378904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:38.379208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.381098 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.383433 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41bab-12a4-4c6d-a89c-d68d4874e7fe None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.393397 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f309ff57750472c9011ccf17eb7089e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.397386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.397962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.398421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.408828 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1153/2313] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:54:38.410403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.422425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.424520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.435596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330d78-dddb-49f9-ba53-cdb65c19646c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.446079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.447481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.448101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.448847 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.450337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.456193 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bbc6f-659d-4b4a-9638-c3df8f88ebe4 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.470170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1161/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:38.536755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1154/2315] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:38.542010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.559973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7fc3d-245b-49a9-b9f8-9bb2af3b9b9b service glance] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.580598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be43e-daf8-4ba3-9ea0-bbfc7e3a6d56 None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.581207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be43e-daf8-4ba3-9ea0-bbfc7e3a6d56 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.581831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be43e-daf8-4ba3-9ea0-bbfc7e3a6d56 None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.585965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1155/2316] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:54:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:54:38.594972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.595620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.596049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.606170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:38.632026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] MFA Rules not processed for user `cff73b0ad3ad44b4bb9d60912e0bbd62`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:38.634518 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.687327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.688893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.689358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.689642 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.690663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.694553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.746384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1162/2317] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:38.753526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.765367 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1156/2318] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:38.780354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a601ac8-fe8f-4f83-89ac-8ff253763120 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.788180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.788508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.788824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.789185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.789439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.790099 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.791762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.792119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:38.804880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1163/2319] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:38.811196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.824348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d97422-a5a9-4e97-a95f-265463c81421 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.829103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5483a4-71b6-4577-9036-4159ff1caab8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.833882 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.835681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.836158 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.837157 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.838449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.839202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.839493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.839941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.840736 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.843588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.860273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.863102 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1dcd-94bd-45be-9f91-d1fd41ccd65c service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.863728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1164/2320] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:38.864922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:38.877428 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e693-4986-45cd-bc2e-3001de75af09 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:38.882479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1157/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:38.894193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:38.896107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.896537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.897224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] PATH_INFO: `/v3/projects/2771769bbb784dbe9442a53359fe359c/users/e696c69473414a368433830811b41177/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.926578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2771769bbb784dbe9442a53359fe359c, user_id=e696c69473414a368433830811b41177, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:38.931977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077c544-6c37-4ab8-b3af-13fa11e97be0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:38.968532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898aa8-6f7c-4320-a6e6-4f9a8330433f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.968814 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898aa8-6f7c-4320-a6e6-4f9a8330433f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.969129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898aa8-6f7c-4320-a6e6-4f9a8330433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:38.972807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1165/2322] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:38 2022] PUT /identity/v3/projects/2771769bbb784dbe9442a53359fe359c/users/e696c69473414a368433830811b41177/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:38.985062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:38.985346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:38.985619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.011078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f5898aa8-6f7c-4320-a6e6-4f9a8330433f None None] MFA Rules not processed for user `789019238c674e5288cd2770dc75ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:39.012437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f5898aa8-6f7c-4320-a6e6-4f9a8330433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:39.023360 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] MFA Rules not processed for user `e696c69473414a368433830811b41177`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:39.024957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:39.036837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:39.096074 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1158/2323] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:39.098818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3403-10f9-47c9-909e-43c5d1bcfaee None None] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.099502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3403-10f9-47c9-909e-43c5d1bcfaee None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.099817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3403-10f9-47c9-909e-43c5d1bcfaee None None] PATH_INFO: `/` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.101749 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1159/2324] 10.222.0.33 () {54 vars in 921 bytes} [Sat Oct 15 13:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 13:54:39.109191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.109191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.110489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.129467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1166/2325] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:39.134193 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.146838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] MFA Rules not processed for user `b10284800d0248778a9b4ece037e3343`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:39.148394 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:39.252177 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:39.261189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248b00-638a-4e35-a3c5-53eb795a910a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.272609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.273429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.273864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.274239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.275029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.278371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.302509 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1160/2326] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Oct 15 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:39.325592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.329254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:39.334269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1167/2327] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:39 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:39.339111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.456935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca37-6903-439f-8fee-6acd246494ae admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.457161 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232fda-589b-44b4-9bcb-47e1e012ed89 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.462302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.462962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.463258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.463504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.464251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.473305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.526785 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1168/2328] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:39 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:39.528438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.541482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bb95c-a4fe-4453-bda2-ff6ef3b0a02c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.547531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.548425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.548759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.549037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.549753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.551697 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.581629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1169/2329] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:39.586241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.593648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.594587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.594587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.594816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.601999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5100-3948-4ed1-a310-d8f1ad272255 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.609205 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.610047 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.610455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.610991 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] PATH_INFO: `/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3/users/c0822b9d2b3346c598c14fd879b9cb2f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.634553 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff3d2febc0e4115b3a0d24bcef0bdb3, user_id=c0822b9d2b3346c598c14fd879b9cb2f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.638362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.671796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1170/2330] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:39 2022] PUT /identity/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3/users/c0822b9d2b3346c598c14fd879b9cb2f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:39.675952 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.697209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:39.814472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.817951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.853832 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1161/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:39.894893 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185177-9718-4999-85e7-fdc08b3562d5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.903265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.904199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.905098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.905455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.906198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.907935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.924100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1171/2332] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:39.928890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.946012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e673a1-c1ce-4e06-9363-796bf0f4f89b service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:39.951692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:39.952902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:39.953249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:39.953588 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] PATH_INFO: `/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3/users/c0822b9d2b3346c598c14fd879b9cb2f/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:39.956573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff3d2febc0e4115b3a0d24bcef0bdb3, user_id=c0822b9d2b3346c598c14fd879b9cb2f, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:39.959585 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a39a-ad38-4e42-814e-95a82356f049 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:39.973889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:39.975937 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:39.977041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1162/2333] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:39 2022] PUT /identity/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3/users/c0822b9d2b3346c598c14fd879b9cb2f/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:40.053545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:40.056093 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:40.056522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:40.088231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:40.134728 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] MFA Rules not processed for user `c0822b9d2b3346c598c14fd879b9cb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:40.136053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:40.151873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252307a-7ad6-4cf2-890c-2e96feacb8c8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:40.242037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:40.243349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:40.243888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:40.244383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:40.246859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:40.255511 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1163/2334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:40.256867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:40.259630 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:40.260900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:40.262771 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:40.274705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1172/2335] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:40.275692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:40.277392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:40.282546 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c07abb-4b49-4f97-9a4a-2c7bdcab9b78 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:40.289761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:40.290490 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:40.290734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:40.291056 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:40.305173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:40.307179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:40.367641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1164/2336] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:40.410371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5deb9-c179-4640-b0e7-6ce23c5aeafc service placement] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:40.422514 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:40.423166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:40.423451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:40.432233 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:40.443855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:40.445310 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f7b4d-497b-41cb-ae24-af1fc0ef8a09 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:40.457775 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1173/2337] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:41.056970 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:41.161275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a0639-844d-450d-bc8d-a4df6106b026 service placement] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:41.166998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:41.167988 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:41.168337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:41.168740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] PATH_INFO: `/v3/users/e696c69473414a368433830811b41177` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:41.170044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e696c69473414a368433830811b41177)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:41.172481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:41.217308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:41.285129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e696c69473414a368433830811b41177'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:41.299359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e696c69473414a368433830811b41177'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:41.300603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e696c69473414a368433830811b41177'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:41.301627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e696c69473414a368433830811b41177'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:41.321919 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e696c69473414a368433830811b41177'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:41.372601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1165/2338] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:41 2022] DELETE /identity/v3/users/e696c69473414a368433830811b41177 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:41.377243 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:41.378273 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:41.380107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:41.401962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:41.403498 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:41.475175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1174/2339] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:41.485871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:41.487434 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:41.557894 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330960ab-1d6c-4f3f-a128-37100ff116ec admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:41.561904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:41.562526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:41.562804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:41.563075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:41.573248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:41.574737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:41.585287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1166/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:41.973691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:41.975166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:41.987999 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f6e4-4a11-4060-90a2-6c9243e5d3e4 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:41.992812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:41.993497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:41.993761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:41.994039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] PATH_INFO: `/v3/projects/2771769bbb784dbe9442a53359fe359c` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:41.995206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2771769bbb784dbe9442a53359fe359c)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:41.997329 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:42.000443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=100 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:42.050472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2771769bbb784dbe9442a53359fe359c', 'request_id': 'req-60c9f784-4770-4f8c-8648-c77368659316'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.057051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2771769bbb784dbe9442a53359fe359c', 'request_id': 'req-60c9f784-4770-4f8c-8648-c77368659316'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.066536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2771769bbb784dbe9442a53359fe359c', 'request_id': 'req-60c9f784-4770-4f8c-8648-c77368659316'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.078073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] The token cache is being invalidate because project 2771769bbb784dbe9442a53359fe359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:42.078378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.079079 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.080938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1175/2341] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:41 2022] DELETE /identity/v3/projects/2771769bbb784dbe9442a53359fe359c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:42.084967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:42.097999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2c17e-d69e-4a61-a934-8f3a597db78d service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:42.175134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:42.175803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:42.176087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:42.176359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] PATH_INFO: `/v3/users/c0822b9d2b3346c598c14fd879b9cb2f` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:42.181708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0822b9d2b3346c598c14fd879b9cb2f)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:42.184000 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:42.240586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:42.249977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0822b9d2b3346c598c14fd879b9cb2f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.260280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0822b9d2b3346c598c14fd879b9cb2f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.261198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0822b9d2b3346c598c14fd879b9cb2f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.261867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0822b9d2b3346c598c14fd879b9cb2f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.272974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-cb1b264d-dde7-4229-8414-8a84a0ce0e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0822b9d2b3346c598c14fd879b9cb2f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:42.296812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1167/2342] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:42 2022] DELETE /identity/v3/users/c0822b9d2b3346c598c14fd879b9cb2f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:42.824347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:42.828773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:42.830522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:42.830941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:42.831454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:42.859010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9f784-4770-4f8c-8648-c77368659316 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:42.872758 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:42.874353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:42.934903 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:42.935730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:42.936120 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:42.936449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] PATH_INFO: `/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:42.937745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff3d2febc0e4115b3a0d24bcef0bdb3)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:42.939889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:42.943901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1168/2343] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:42.959529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:42.961178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:43.009709 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff3d2febc0e4115b3a0d24bcef0bdb3', 'request_id': 'req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:43.018984 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff3d2febc0e4115b3a0d24bcef0bdb3', 'request_id': 'req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:43.031518 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff3d2febc0e4115b3a0d24bcef0bdb3', 'request_id': 'req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:43.045912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] The token cache is being invalidate because project 0ff3d2febc0e4115b3a0d24bcef0bdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:43.046367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:43.047210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9e7dbda9-151a-49a2-b4e0-ea6fced16a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:43.049143 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1176/2344] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:42 2022] DELETE /identity/v3/projects/0ff3d2febc0e4115b3a0d24bcef0bdb3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:43.051779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2556-a0be-492b-aa53-03a111d6c834 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.055398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f908-ed87-4643-a92f-bcf03e61d20a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.055398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f908-ed87-4643-a92f-bcf03e61d20a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.055398 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f908-ed87-4643-a92f-bcf03e61d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.079708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f920f908-ed87-4643-a92f-bcf03e61d20a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:43.081356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f920f908-ed87-4643-a92f-bcf03e61d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:43.104082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:43.174571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.176567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.177036 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.177457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.180826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:43.190971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1177/2345] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:43.198723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.199010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.199266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.203705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:43.222542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:43.224809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:43.240025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1178/2346] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:43.242880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.269443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24427d-69c6-4c7b-b244-d1032ae9e146 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.276239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.276872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.277145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.280351 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.281404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:43.281662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.283474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.314324 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1179/2347] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:43.317529 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.318764 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.319442 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.331824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1169/2348] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:54:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:54:43.337364 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c603b5-adbf-46a9-b342-1f4b86eadefa admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.345417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.346234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.347662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.348122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.348911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.351313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.410547 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.414280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1180/2349] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:43 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:43.424081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5429502-e6c6-4e9b-8a4a-d9c697840a27 service swift] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.598420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.599063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.599353 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.599686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.602227 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.604427 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.690130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.717081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1170/2350] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:43 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:43.722489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32005-c718-4eec-93f8-4e6ad4876b4b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.735383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.736152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.736419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.736843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.737662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.739821 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.761097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1181/2351] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:43.765639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.785991 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f05c8-9a6a-4336-b7d3-fa1823cec4c5 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.795147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.795857 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.796147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.796424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.797351 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.799488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc69e-6750-44d4-b53f-6e8b1b0847a8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.820642 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1171/2352] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:43.825474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:43.847751 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c224a-a58b-48eb-8556-e8147b7bcf2c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:43.858756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:43.860367 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.860958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.861730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] PATH_INFO: `/v3/projects/2b8327c72f414b80af2e01b00d708028/users/0115daba234e490f956d3ea70d1e0765/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:43.895473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8327c72f414b80af2e01b00d708028, user_id=0115daba234e490f956d3ea70d1e0765, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:43.907344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:43.962542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1182/2353] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:43 2022] PUT /identity/v3/projects/2b8327c72f414b80af2e01b00d708028/users/0115daba234e490f956d3ea70d1e0765/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:43.977052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:43.977605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:43.977871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:44.075634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] MFA Rules not processed for user `0115daba234e490f956d3ea70d1e0765`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:44.077231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:44.234389 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1172/2354] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:44.248506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:44.250692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:44.393851 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739354dd-6a22-43b7-ae29-e1a9e3dddfb5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:44.398493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:44.399884 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:44.401051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:44.401150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:44.412990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:44.414768 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c57e7-1fb0-464b-a99a-8f341e26ba92 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:44.442462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1183/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:44.471254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:44.496853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:44.573180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac65de-057e-4e02-b54c-17333ae30ae8 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:44.580107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:44.581044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:44.581393 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:44.581699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] PATH_INFO: `/v3/users/0115daba234e490f956d3ea70d1e0765` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:44.583617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0115daba234e490f956d3ea70d1e0765)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:44.586484 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:44.675199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0115daba234e490f956d3ea70d1e0765'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:44.684605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0115daba234e490f956d3ea70d1e0765'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:44.685959 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0115daba234e490f956d3ea70d1e0765'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:44.686637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0115daba234e490f956d3ea70d1e0765'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:44.698090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0115daba234e490f956d3ea70d1e0765'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:44.757564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1173/2356] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:44 2022] DELETE /identity/v3/users/0115daba234e490f956d3ea70d1e0765 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:44.764270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:44.764536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:44.764812 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:44.790685 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:44.792103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:44.857965 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:44.863166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:44.900951 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:44.940449 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1184/2357] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:54:44.957255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:44.958708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:45.118343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5ca06-c06c-4ece-b374-b630138f9dc1 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:45.137954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:45.142179 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:45.142551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:45.142829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:45.173340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:45.175259 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:45.181446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501322fa-7158-46a2-87be-aff6d584ba35 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:45.188735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:45.189386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:45.189665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:45.190081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:45.193963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1185/2358] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:45.201545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:45.232571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:45.234559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c2cb8-bd9f-4807-b586-d90439f24ce4 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:45.262030 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1174/2359] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:45.912600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:45.914214 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:45.932757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44ee4-6855-4200-ad4f-0820a6bcdad6 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:45.939138 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:45.939508 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:45.939816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:45.940066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] PATH_INFO: `/v3/projects/2b8327c72f414b80af2e01b00d708028` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:45.941366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8327c72f414b80af2e01b00d708028)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:45.944001 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.044542 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8327c72f414b80af2e01b00d708028', 'request_id': 'req-59f9f625-83e4-40aa-8775-ff4384e7ea50'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:46.053060 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8327c72f414b80af2e01b00d708028', 'request_id': 'req-59f9f625-83e4-40aa-8775-ff4384e7ea50'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:46.069165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8327c72f414b80af2e01b00d708028', 'request_id': 'req-59f9f625-83e4-40aa-8775-ff4384e7ea50'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:46.098689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] The token cache is being invalidate because project 2b8327c72f414b80af2e01b00d708028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:46.098925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:46.099863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-59f9f625-83e4-40aa-8775-ff4384e7ea50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:46.109062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1186/2360] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:45 2022] DELETE /identity/v3/projects/2b8327c72f414b80af2e01b00d708028 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:46.113878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.114166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.114448 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.143007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:46.144498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:46.184382 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:46.259853 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1175/2361] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:46.268057 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.268363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.268636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.308925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:46.310672 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:46.326212 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1187/2362] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:46.332594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.344072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0fd2b-3580-4bf8-a7b4-3fe10e39bc19 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.349165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.349743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.350242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.350501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.351574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:54:46.351574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.353148 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.367930 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1176/2363] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:54:46.373423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.384260 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbef5bc-5e98-444c-b21f-d5fbb6e526a8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.389617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.390770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.391014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.391327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.392058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.394021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.441668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1188/2364] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:46 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:46.446182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.457118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384bdba-4af8-4e33-bbd8-0fd29e054a46 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.549053 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.550136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.550475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.550808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.551739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.554079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.593751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1177/2365] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:46 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:46.597585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.616247 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56156c6-98f5-4dcb-8752-3e50bf10a3ed admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.621703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.622322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.622600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.622910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.624698 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.627551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.648683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1189/2366] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:46.650268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.682964 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d7f-2f0d-41fa-844f-8150dc6cd7b7 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.704318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.707837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.707837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.707837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.715893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.715893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ddf54-2ced-4208-bdb8-83048d7ad582 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.755575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1178/2367] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:54:46.758667 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:46.776282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51887d8-fb27-49fd-8041-a8e50e2e2886 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:46.799932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:46.801109 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.801551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.801968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] PATH_INFO: `/v3/projects/1357e82b2105457c8f6a745fe7aa8e78/users/023f3d8d3bfb4dfd8ae34bc58659c475/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.847828 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1357e82b2105457c8f6a745fe7aa8e78, user_id=023f3d8d3bfb4dfd8ae34bc58659c475, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:46.851019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:46.890258 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1190/2368] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:46 2022] PUT /identity/v3/projects/1357e82b2105457c8f6a745fe7aa8e78/users/023f3d8d3bfb4dfd8ae34bc58659c475/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:46.900826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:46.901166 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:46.901451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:46.979932 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] MFA Rules not processed for user `023f3d8d3bfb4dfd8ae34bc58659c475`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:46.981240 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:47.102222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1179/2369] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:47.106297 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.123432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:47.197857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003162ba-0fb8-4cdf-9a30-acb1b8620912 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.203160 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.203839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.204124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.204400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.205062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.207388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.239977 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1191/2370] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:54:47 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:54:47.244312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.257708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc261c-2ca2-49d6-aaa8-f0bf351b689f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.275879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:47.335567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.336253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.336532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.336943 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.337451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.340081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.378272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1180/2371] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:54:47 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:54:47.382565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.394163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c3c21-120a-4bbc-9a41-d4c9c688a1a9 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.399265 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.400092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.400376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.400731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.401619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.403942 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.419990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1192/2372] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:47.421854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.432414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dfb4a-4bbe-42f7-b443-472003d2a6df admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.437629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.438365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.438653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.438935 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] PATH_INFO: `/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e/users/9f2f80993d2a4db0b17ecea792261b04/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.456137 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a679afd2dbe4aa3ad020b89fcf4228e, user_id=9f2f80993d2a4db0b17ecea792261b04, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.458888 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.480886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1181/2373] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:47 2022] PUT /identity/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e/users/9f2f80993d2a4db0b17ecea792261b04/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:47.481823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.493473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53429398-a461-4cbc-8afc-4a7dd790a3dc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.556789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.557735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.558014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.558299 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.558994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.560691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332df571-9a9a-4f57-b021-d7a193f71818 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.572328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1193/2374] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:54:47.576927 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.591816 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f595af-4da7-436e-b9db-b30a3d0fc1d2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.597660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.598601 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.598877 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.599257 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] PATH_INFO: `/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e/users/9f2f80993d2a4db0b17ecea792261b04/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.601512 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a679afd2dbe4aa3ad020b89fcf4228e, user_id=9f2f80993d2a4db0b17ecea792261b04, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.604226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.616027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1182/2375] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:54:47 2022] PUT /identity/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e/users/9f2f80993d2a4db0b17ecea792261b04/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:47.628534 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.628916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.629151 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.666031 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] MFA Rules not processed for user `9f2f80993d2a4db0b17ecea792261b04`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:47.667282 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:47.744366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1194/2376] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:47.756016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:47.757893 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:47.846840 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a875ef-0ff7-4dcd-bb1e-a1e93552d797 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:47.850785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:47.851914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:47.852181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:47.852449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:47.954632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:47.959230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f6bef-fb9f-4bf5-8cfd-bf7e0c7a8fe4 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:47.976272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1183/2377] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:54:50.896794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:50.909391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:51.008415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768befd-08cc-46a2-8277-3715c202e011 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:51.015527 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:51.016374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:51.016625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:51.016896 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] PATH_INFO: `/v3/users/023f3d8d3bfb4dfd8ae34bc58659c475` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:51.018074 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023f3d8d3bfb4dfd8ae34bc58659c475)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:51.020065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:51.074213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023f3d8d3bfb4dfd8ae34bc58659c475'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.082226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023f3d8d3bfb4dfd8ae34bc58659c475'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.082990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023f3d8d3bfb4dfd8ae34bc58659c475'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.083588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023f3d8d3bfb4dfd8ae34bc58659c475'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.092902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023f3d8d3bfb4dfd8ae34bc58659c475'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.114701 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1195/2378] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:50 2022] DELETE /identity/v3/users/023f3d8d3bfb4dfd8ae34bc58659c475 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:51.119608 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:51.120178 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:51.120446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:51.142436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:51.143653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:51.170567 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:51.228798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1184/2379] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:51.242088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:51.244495 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:51.310148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f676d5-163d-4534-bf81-4a0606af9185 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:51.313957 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:51.314571 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:51.314844 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:51.315113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:51.326274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:51.327870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:51.337932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1196/2380] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:54:51.630612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:51.632313 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:51.649008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb048aa-1eb6-4934-bdcc-d6268b32fe3e None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:51.656199 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:51.657159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:51.671979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:51.672699 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] PATH_INFO: `/v3/projects/1357e82b2105457c8f6a745fe7aa8e78` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:51.674833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1357e82b2105457c8f6a745fe7aa8e78)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:51.678376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:51.765769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1357e82b2105457c8f6a745fe7aa8e78', 'request_id': 'req-6f789041-f800-49fb-ab21-9dc11b55a723'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.777914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1357e82b2105457c8f6a745fe7aa8e78', 'request_id': 'req-6f789041-f800-49fb-ab21-9dc11b55a723'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.788181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1357e82b2105457c8f6a745fe7aa8e78', 'request_id': 'req-6f789041-f800-49fb-ab21-9dc11b55a723'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.803191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] The token cache is being invalidate because project 1357e82b2105457c8f6a745fe7aa8e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:51.803580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.804583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.806745 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1185/2381] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:51 2022] DELETE /identity/v3/projects/1357e82b2105457c8f6a745fe7aa8e78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:54:51.811614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:51.823463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689fbe3-78eb-402a-831f-34b9fe0bc027 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:51.853215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:51.907898 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:51.908859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:51.908859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:51.909175 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] PATH_INFO: `/v3/users/9f2f80993d2a4db0b17ecea792261b04` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:51.910287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2f80993d2a4db0b17ecea792261b04)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:51.912656 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:51.982734 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2f80993d2a4db0b17ecea792261b04'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.994328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2f80993d2a4db0b17ecea792261b04'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.995150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2f80993d2a4db0b17ecea792261b04'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:51.995849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2f80993d2a4db0b17ecea792261b04'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.006048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-8112778f-194d-40b1-a457-168a085c5695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2f80993d2a4db0b17ecea792261b04'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.025607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1197/2382] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:54:51 2022] DELETE /identity/v3/users/9f2f80993d2a4db0b17ecea792261b04 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:52.409609 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:52.412300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:52.435264 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789041-f800-49fb-ab21-9dc11b55a723 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:52.507118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:52.507775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:52.508081 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:52.508350 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] PATH_INFO: `/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:52.509514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a679afd2dbe4aa3ad020b89fcf4228e)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:52.511488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:52.568265 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:52.569825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a679afd2dbe4aa3ad020b89fcf4228e', 'request_id': 'req-a3f1ff4a-86c3-4301-913d-21bae5306422'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.581371 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a679afd2dbe4aa3ad020b89fcf4228e', 'request_id': 'req-a3f1ff4a-86c3-4301-913d-21bae5306422'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.593799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a679afd2dbe4aa3ad020b89fcf4228e', 'request_id': 'req-a3f1ff4a-86c3-4301-913d-21bae5306422'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.606660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] The token cache is being invalidate because project 7a679afd2dbe4aa3ad020b89fcf4228e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:54:52.607041 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.607715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:54:52.609270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1186/2383] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:54:52 2022] DELETE /identity/v3/projects/7a679afd2dbe4aa3ad020b89fcf4228e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:54:58.714662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:58.715152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:58.715270 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:58.737522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:54:58.738801 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:58.801862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1198/2384] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:54:58.815170 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:54:58.817218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:54:58.899966 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ff4a-86c3-4301-913d-21bae5306422 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:54:58.905150 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:54:58.905957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:54:58.906234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:54:58.906526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:54:58.915503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:54:58.917127 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:54:58.925983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1187/2385] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:55:08.794325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:08.922535 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:36.125488 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:36.127403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:36.274266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca66b-c21a-4ee3-b90d-b9eaaac9ceb8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:36.281280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:36.282538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:36.283039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:36.283460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:36.286236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:36.312733 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:36.317076 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26461d2-b0f3-4904-a9fb-bbda954c5eb9 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:36.340022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1199/2386] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:40.399355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:40.400831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:40.475335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c2b4-3edd-41c1-a230-4784d1ac6e16 service swift] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:40.479155 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:40.479810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:40.480113 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:40.480384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:40.482156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:40.549752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:40.551209 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:40.562304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1188/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:55:43.169019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adee64-a495-45b1-a065-5547435af6cb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:43.169573 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adee64-a495-45b1-a065-5547435af6cb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:43.169686 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adee64-a495-45b1-a065-5547435af6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:43.199875 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-64adee64-a495-45b1-a065-5547435af6cb None None] MFA Rules not processed for user `789019238c674e5288cd2770dc75ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:43.201128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-64adee64-a495-45b1-a065-5547435af6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:43.296026 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1200/2388] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:43.668779 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:43.682581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab9877-7f7e-402a-a21a-b863eba6fb4a service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:43.687067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:43.687997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:43.688446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:43.688883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:43.690865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:43.703948 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:43.705697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:43.733507 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1189/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:44.190808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adee64-a495-45b1-a065-5547435af6cb None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:44.192302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-64adee64-a495-45b1-a065-5547435af6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:44.216924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adee64-a495-45b1-a065-5547435af6cb None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:44.222808 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:44.223465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.223743 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.224046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] PATH_INFO: `/v3/users/e35bc05d950647809337ef28ab710e1b` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.225381 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35bc05d950647809337ef28ab710e1b)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:44.227346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:44.282267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35bc05d950647809337ef28ab710e1b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.289700 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35bc05d950647809337ef28ab710e1b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.290438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35bc05d950647809337ef28ab710e1b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.291089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35bc05d950647809337ef28ab710e1b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.300114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-69eacf5f-4b9e-4062-9d12-50ec525a6054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35bc05d950647809337ef28ab710e1b'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.323699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1201/2390] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:55:44 2022] DELETE /identity/v3/users/e35bc05d950647809337ef28ab710e1b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:44.527596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:44.545839 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a55b-8a16-4434-becc-0a85fc23846c service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:44.621515 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:44.622368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.622891 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.623214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] PATH_INFO: `/v3/projects/332539f9e45341f2b5215138a78e8c55` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.628693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=332539f9e45341f2b5215138a78e8c55)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:44.630795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:44.676921 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:44.685516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332539f9e45341f2b5215138a78e8c55', 'request_id': 'req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.695201 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332539f9e45341f2b5215138a78e8c55', 'request_id': 'req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.702202 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332539f9e45341f2b5215138a78e8c55', 'request_id': 'req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.713235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] The token cache is being invalidate because project 332539f9e45341f2b5215138a78e8c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:55:44.713524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.714329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-f6a4fbe9-3768-473b-a018-93c6c6fb30ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:44.716134 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1190/2391] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:55:44 2022] DELETE /identity/v3/projects/332539f9e45341f2b5215138a78e8c55 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:55:44.721658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.721968 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.722239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.731219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:44.746559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:44.747809 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:44.814313 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1202/2392] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:44.824359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.824636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.824906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.851878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:44.853145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:44.865880 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1191/2393] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:44.871118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:44.882023 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87570-d2e7-4d85-80c6-4e6fe8354b6d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:44.886739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:44.887336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.887608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.887908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.888558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:55:44.888856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:44.890600 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:44.902423 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1203/2394] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:55:44.907488 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:44.925132 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feace1f-c0cb-4b4f-a8da-66d247dcdd43 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:44.933190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:44.934096 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:44.934429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:44.934719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:44.935580 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:44.937707 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:44.969468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1192/2395] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:55:44 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:44.974292 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:44.985721 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3fa2-4af4-4766-a5f3-573f1a53ae96 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.046757 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.047368 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.047654 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.047941 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.048586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.050543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.081830 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1204/2396] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:55:44 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:55:45.088720 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.108069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712189-fde0-41b7-a8df-f965eca891bd admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.118407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.119045 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.119324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.119635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.124864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.126647 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.150256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1193/2397] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:45.154349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.171717 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ecbb-9636-49c8-a140-d562cd8f8c48 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.177417 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.178045 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.188040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.188040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.188040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.188040 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ba4ea-a274-420a-8750-43f9f43a39cd admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.209455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1205/2398] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:45.214489 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.225878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4c99-2477-4d54-959c-e3ff2bb9f080 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.231347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.232562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.232562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.232923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] PATH_INFO: `/v3/projects/cfa5b7bdea654675b62be098521aeb04/users/f1e6a62ce5c7474a8d81f91e9f7acd73/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.252598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa5b7bdea654675b62be098521aeb04, user_id=f1e6a62ce5c7474a8d81f91e9f7acd73, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.255348 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.274997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1194/2399] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:45 2022] PUT /identity/v3/projects/cfa5b7bdea654675b62be098521aeb04/users/f1e6a62ce5c7474a8d81f91e9f7acd73/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:55:45.286222 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.286589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.286948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.318858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] MFA Rules not processed for user `f1e6a62ce5c7474a8d81f91e9f7acd73`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:45.320146 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:45.385240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:45.393376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1206/2400] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:45.397080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.472343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6fad5-f1dc-40a0-8889-f6903f59a69f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.477430 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.478244 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.478524 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.478788 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.479453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.481436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.516694 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1195/2401] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:55:45 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:45.521263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.533594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259de7b-b6e5-4b3d-bda8-72f94281503a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.608295 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.609325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.610018 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.610493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.611684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.614190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.645098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1207/2402] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:55:45 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:45.649623 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.661748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115de55-c4f7-4ebf-86bc-64bfff09dcbe admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.667680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.668629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.669005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.669403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.670163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.672100 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.684365 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1196/2403] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:45.689163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.701989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34b1d-aa42-4113-af7c-3e5c84352d44 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.709103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.710665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.711158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.711624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] PATH_INFO: `/v3/projects/8560c013184c4a0db74128d05790f513/users/1ae6e198c9554839a1968fe8061fd06a/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.735719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8560c013184c4a0db74128d05790f513, user_id=1ae6e198c9554839a1968fe8061fd06a, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.738489 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.757404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1208/2404] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:45 2022] PUT /identity/v3/projects/8560c013184c4a0db74128d05790f513/users/1ae6e198c9554839a1968fe8061fd06a/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:45.761855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.772625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1be65-329a-4c31-8853-4b471d36cd21 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.812234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:45.844343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.844994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.845274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.845621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.846185 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.847811 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02c566-0110-419f-95c8-5ba3dde66c93 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.858568 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1197/2405] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:45.863346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:45.874348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d50ad-311c-43b9-a810-c23afc58d75f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:45.880077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:45.880752 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.881029 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.881302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] PATH_INFO: `/v3/projects/8560c013184c4a0db74128d05790f513/users/1ae6e198c9554839a1968fe8061fd06a/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.883276 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8560c013184c4a0db74128d05790f513, user_id=1ae6e198c9554839a1968fe8061fd06a, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:45.885960 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:45.897767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1209/2406] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:45 2022] PUT /identity/v3/projects/8560c013184c4a0db74128d05790f513/users/1ae6e198c9554839a1968fe8061fd06a/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:55:45.911020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:45.911456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:45.912010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:45.945539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] MFA Rules not processed for user `1ae6e198c9554839a1968fe8061fd06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:45.946748 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:46.026974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1198/2407] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:46.041637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:46.044641 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:46.119657 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd91448-74c6-4bb0-9940-6e4d96f32637 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:46.124544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:46.125226 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:46.125522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:46.125784 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:46.136130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:46.137599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:46.147691 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1210/2408] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:46.232735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:46.243635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90216-07e2-4631-a034-766f0b223e7c None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:46.249078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:46.249989 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:46.250759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:46.251214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:46.340852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:46.342399 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc34e-29c2-4500-957e-f1659ca495f0 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:46.355578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1199/2409] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:52.651706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:52.713167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:52.727458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5235-0876-4133-a281-562cc90e92fa service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:52.732683 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:52.733374 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:52.733651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:52.733932 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] PATH_INFO: `/v3/users/f1e6a62ce5c7474a8d81f91e9f7acd73` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:52.735107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e6a62ce5c7474a8d81f91e9f7acd73)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:52.737521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:52.799679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e6a62ce5c7474a8d81f91e9f7acd73'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:52.808017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e6a62ce5c7474a8d81f91e9f7acd73'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:52.808817 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e6a62ce5c7474a8d81f91e9f7acd73'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:52.809407 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e6a62ce5c7474a8d81f91e9f7acd73'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:52.819460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e6a62ce5c7474a8d81f91e9f7acd73'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:52.841266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1211/2410] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:55:52 2022] DELETE /identity/v3/users/f1e6a62ce5c7474a8d81f91e9f7acd73 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:52.847020 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:52.847587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:52.847587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:52.869945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:52.871191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:52.943732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=100 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:52.955766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1200/2411] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:52.967124 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:52.968774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:53.052274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7760-3d1b-47df-95d0-11832da3344c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:53.055925 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:53.056551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:53.056826 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:53.057132 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:53.068506 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:53.069829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:53.081396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1212/2412] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:53.385340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:53.387235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:53.407768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f4a65-e476-4e65-a755-c0a0bde14f26 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:53.418612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:53.419505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:53.419936 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:53.420314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] PATH_INFO: `/v3/projects/cfa5b7bdea654675b62be098521aeb04` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:53.421680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa5b7bdea654675b62be098521aeb04)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:53.425065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:53.482233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa5b7bdea654675b62be098521aeb04', 'request_id': 'req-977ebdf7-af07-43ea-a182-5274b98b1f99'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.490581 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa5b7bdea654675b62be098521aeb04', 'request_id': 'req-977ebdf7-af07-43ea-a182-5274b98b1f99'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.499039 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa5b7bdea654675b62be098521aeb04', 'request_id': 'req-977ebdf7-af07-43ea-a182-5274b98b1f99'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.511556 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] The token cache is being invalidate because project cfa5b7bdea654675b62be098521aeb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:55:53.511871 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.512548 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.514206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1201/2413] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:55:53 2022] DELETE /identity/v3/projects/cfa5b7bdea654675b62be098521aeb04 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:53.519484 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:53.529740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4351-21ae-4bc8-8f20-f2a20b6738b1 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:53.594604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:53.595468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:53.595468 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:53.596294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] PATH_INFO: `/v3/users/1ae6e198c9554839a1968fe8061fd06a` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:53.597190 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae6e198c9554839a1968fe8061fd06a)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:53.599130 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:53.616599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:53.654049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae6e198c9554839a1968fe8061fd06a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.661976 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae6e198c9554839a1968fe8061fd06a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.662710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae6e198c9554839a1968fe8061fd06a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.663319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae6e198c9554839a1968fe8061fd06a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.678485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-09c20ba8-3cbd-4cc1-8953-93c49b1081ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae6e198c9554839a1968fe8061fd06a'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:53.702201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1213/2414] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:55:53 2022] DELETE /identity/v3/users/1ae6e198c9554839a1968fe8061fd06a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:54.004773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.006246 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:54.020307 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebdf7-af07-43ea-a182-5274b98b1f99 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.090450 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.091058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.091343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.091622 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] PATH_INFO: `/v3/projects/8560c013184c4a0db74128d05790f513` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.092791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8560c013184c4a0db74128d05790f513)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.094730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.151708 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8560c013184c4a0db74128d05790f513', 'request_id': 'req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:54.162401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8560c013184c4a0db74128d05790f513', 'request_id': 'req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:54.169216 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8560c013184c4a0db74128d05790f513', 'request_id': 'req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:54.180755 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] The token cache is being invalidate because project 8560c013184c4a0db74128d05790f513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:55:54.181043 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:54.181693 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4ac2a7cf-fce3-4f1d-8c29-7ed72aa921b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:55:54.183204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1202/2415] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:55:54 2022] DELETE /identity/v3/projects/8560c013184c4a0db74128d05790f513 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:54.189472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.189761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.190037 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.212881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:54.214128 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:54.284352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1214/2416] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:54.292595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.292898 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.293186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.322094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:54.324228 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:54.338555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1203/2417] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:54.345665 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.356038 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66dac-6d3a-4577-bbd9-ca798a4f745b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.363071 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.364575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.364962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.365346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.366348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:55:54.366887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.369471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.384885 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1215/2418] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:55:54.390605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.398739 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:54.403278 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef891b6e-8367-4143-9324-96bdad817cb7 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.411090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.411706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.412007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.412281 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.412912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.415191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.451582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1204/2419] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:54.456032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.466862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f152-74c9-47a3-a20c-8a25a1465881 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.536666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.537401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.537681 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.537949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.538610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.540558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.563839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1216/2420] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:54.568754 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.578791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07674bb1-0f48-498b-b5ef-947516c4e27b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.584176 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.584789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.585072 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.585341 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.586018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.587621 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.598641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1205/2421] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:54.602962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.613438 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c50df-1cb1-4ce8-9a4a-c17f5c81c524 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.618181 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.618886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.619166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.619441 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.620125 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.621720 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c3d-5f6c-4adb-b978-cb1866b845f1 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.627671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:54.634007 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1217/2422] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:55:54.639224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.652295 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0729dd-94a1-4772-bf1f-7ed95c879544 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.657254 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.658146 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.658941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.659212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] PATH_INFO: `/v3/projects/6e106ddab8214ac69488d7cc32bc2c53/users/9996f93afb2b4001a321884ca44dbe78/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.675336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e106ddab8214ac69488d7cc32bc2c53, user_id=9996f93afb2b4001a321884ca44dbe78, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.678239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.701421 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1206/2423] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:54 2022] PUT /identity/v3/projects/6e106ddab8214ac69488d7cc32bc2c53/users/9996f93afb2b4001a321884ca44dbe78/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:54.719388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.719971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.720446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.752912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] MFA Rules not processed for user `9996f93afb2b4001a321884ca44dbe78`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:54.754206 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:54.847410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1218/2424] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:54.852300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.930803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d7d7-cdf9-434e-af90-7a6ef9172012 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:54.935701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:54.936432 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:54.936775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:54.937061 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:54.937868 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:54.939997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:54.973951 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1207/2425] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:54.978359 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:54.989909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bceb4-5890-4852-9660-87fbb15170ae None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.058487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.059616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.060145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.060628 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.061356 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.063938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.098474 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1219/2426] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:55:54 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:55:55.100007 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:55.125960 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31c32-e513-4824-94b3-cae20b6c22dc admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.134573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.135222 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.135543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.135854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.136485 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.138109 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.150643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1208/2427] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:55.155907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:55.167390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8b003-7f6f-4c7a-9892-7ada610ad730 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.172716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.173519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.173793 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.174034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] PATH_INFO: `/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39/users/280e8bba5c6441f3b6480a0fb83ed5ab/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.191839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c59897b14a64b5ab3a62d711b2f6c39, user_id=280e8bba5c6441f3b6480a0fb83ed5ab, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.194534 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.210666 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1220/2428] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:55 2022] PUT /identity/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39/users/280e8bba5c6441f3b6480a0fb83ed5ab/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:55.215378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:55.228682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccab5f-10cf-4a80-b1b1-143c8a789ced admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.297352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.297969 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.298337 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.298605 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.299514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.301472 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d376012-ab6c-4c30-9c8e-542e4d287c49 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.315058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1209/2429] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:55:55.320224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:55.331444 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd545-fcb0-4af1-901e-0533a3993ab9 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.336668 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.337363 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.337631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.337901 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] PATH_INFO: `/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39/users/280e8bba5c6441f3b6480a0fb83ed5ab/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.342850 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c59897b14a64b5ab3a62d711b2f6c39, user_id=280e8bba5c6441f3b6480a0fb83ed5ab, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.348127 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.358822 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1221/2430] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:55:55 2022] PUT /identity/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39/users/280e8bba5c6441f3b6480a0fb83ed5ab/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:55:55.371938 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.372269 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.375311 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.407431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] MFA Rules not processed for user `280e8bba5c6441f3b6480a0fb83ed5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:55:55.409174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:55.415435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:55.496163 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1210/2431] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:55:55.510987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:55.513322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:55:55.569584 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:55.584631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a1fb-8ae7-4be9-82ec-a6b92d10f543 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:55.588462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:55.589097 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:55.589362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:55.589636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:55.655669 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:55.657215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:55.669740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1222/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:55:58.420123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:55:58.430997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312345-1c53-4a66-b13e-fc18fdaaaf74 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:55:58.435308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:55:58.435994 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:55:58.436268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:55:58.436532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:55:58.446686 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:55:58.448181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a10317-d6e1-4e66-a0b3-e3ab0e3903e3 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:55:58.459379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1211/2433] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:05.665284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=29 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:08.454234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=32 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:11.312085 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:11.382880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f794-cac7-4448-8253-e142a5374d8a service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:11.388189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:11.388805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:11.389076 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:11.389347 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] PATH_INFO: `/v3/users/9996f93afb2b4001a321884ca44dbe78` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:11.390520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9996f93afb2b4001a321884ca44dbe78)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:11.392492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:11.451425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9996f93afb2b4001a321884ca44dbe78'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:11.458927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9996f93afb2b4001a321884ca44dbe78'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:11.459598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9996f93afb2b4001a321884ca44dbe78'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:11.460231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9996f93afb2b4001a321884ca44dbe78'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:11.470458 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9996f93afb2b4001a321884ca44dbe78'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:11.488403 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1223/2434] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:56:11 2022] DELETE /identity/v3/users/9996f93afb2b4001a321884ca44dbe78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:11.493420 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:11.493939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:11.493939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:11.514119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:11.515314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:11.579449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1212/2435] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:56:11.589810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:11.591406 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:11.653544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0faa0-ae83-4b7e-b895-386f58eda6e2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:11.657209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:11.658331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:11.658615 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:11.658887 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:11.669577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:11.671221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:11.682334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1224/2436] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:11.980076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:11.981629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:11.994431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65a88-b079-4852-8095-ab3b3294f85a None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:11.999924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:12.000578 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.001499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.001767 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] PATH_INFO: `/v3/projects/6e106ddab8214ac69488d7cc32bc2c53` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.002993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e106ddab8214ac69488d7cc32bc2c53)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:12.004979 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:12.055355 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e106ddab8214ac69488d7cc32bc2c53', 'request_id': 'req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.064583 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e106ddab8214ac69488d7cc32bc2c53', 'request_id': 'req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.071177 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e106ddab8214ac69488d7cc32bc2c53', 'request_id': 'req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.082723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] The token cache is being invalidate because project 6e106ddab8214ac69488d7cc32bc2c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:56:12.083010 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.083864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.085444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1213/2437] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:56:11 2022] DELETE /identity/v3/projects/6e106ddab8214ac69488d7cc32bc2c53 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:12.090155 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:12.100169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e266-fc9c-418b-bf4e-b5c407cfaab5 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:12.119209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:12.168236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:12.168754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.169069 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.169341 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] PATH_INFO: `/v3/users/280e8bba5c6441f3b6480a0fb83ed5ab` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.170675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280e8bba5c6441f3b6480a0fb83ed5ab)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:12.172636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:12.228813 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280e8bba5c6441f3b6480a0fb83ed5ab'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.237934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280e8bba5c6441f3b6480a0fb83ed5ab'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.239030 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280e8bba5c6441f3b6480a0fb83ed5ab'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.240314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280e8bba5c6441f3b6480a0fb83ed5ab'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.252221 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-cdf2ebc2-7dae-48da-96ae-2521475e0349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280e8bba5c6441f3b6480a0fb83ed5ab'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.273152 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1225/2438] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:56:12 2022] DELETE /identity/v3/users/280e8bba5c6441f3b6480a0fb83ed5ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:12.557324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:12.559260 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:12.576336 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc53d0b-e1dc-468d-a03b-ff7915a53bdd admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:12.638165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:12.638803 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.639080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.639359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] PATH_INFO: `/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.640639 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c59897b14a64b5ab3a62d711b2f6c39)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:12.642555 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:12.677048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:12.695687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c59897b14a64b5ab3a62d711b2f6c39', 'request_id': 'req-60913cd0-7db7-44e7-b972-f9ff78ff0992'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.710309 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c59897b14a64b5ab3a62d711b2f6c39', 'request_id': 'req-60913cd0-7db7-44e7-b972-f9ff78ff0992'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.721807 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c59897b14a64b5ab3a62d711b2f6c39', 'request_id': 'req-60913cd0-7db7-44e7-b972-f9ff78ff0992'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.733589 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] The token cache is being invalidate because project 2c59897b14a64b5ab3a62d711b2f6c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:56:12.733878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.734579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-60913cd0-7db7-44e7-b972-f9ff78ff0992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:12.736145 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1214/2439] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:56:12 2022] DELETE /identity/v3/projects/2c59897b14a64b5ab3a62d711b2f6c39 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:12.743604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.744231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.744231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.766194 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:12.767424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:12.842348 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1226/2440] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:12.851237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.851508 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.851766 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.873443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:12.874661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:12.883616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1215/2441] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:12.888269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:12.898992 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8994e-9995-4330-a89e-6c81a39f4aac None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:12.903725 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:12.904385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.904663 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.904933 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.905589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:56:12.905888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:12.907880 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:12.922865 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1227/2442] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:56:12.929598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:12.939439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bece6-ab98-4c59-b254-06245b618cb1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:12.945194 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:12.945862 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:12.946174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:12.946545 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:12.947301 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:12.949501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:12.979354 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1216/2443] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:56:12 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:56:12.983863 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:12.994581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f5a1-2ebd-4741-8c12-bf9ee55914c2 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:13.020869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:13.060383 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:13.061032 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.061308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.061580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.062236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:13.064201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:13.090173 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1228/2444] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:56:12 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:56:13.094610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:13.107147 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a24c-fc96-4d06-aa29-c6ef0a6b0624 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:13.112106 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:13.112751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.113032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.113308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.113981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:13.115672 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:13.127602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1217/2445] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:56:13.133041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:13.148393 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37888a3-2e2a-4940-8dc5-f873b6e8ae44 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:13.154410 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:13.155021 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.155294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.155722 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.156408 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:13.158349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99feca-be60-43a5-a67c-ddddba80eb1f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:13.169337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1229/2446] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:56:13.175691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:13.186486 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676139b3-c01a-40b9-8ed0-73f105bf4b12 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:13.191180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:13.191873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.192182 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.192436 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] PATH_INFO: `/v3/projects/6caa3ad4a4dc48efbd2ec452fe2d7fd3/users/10c1a86fb8da4c42ab322b70327e813c/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.208229 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caa3ad4a4dc48efbd2ec452fe2d7fd3, user_id=10c1a86fb8da4c42ab322b70327e813c, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:13.211606 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:13.228625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1218/2447] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:56:13 2022] PUT /identity/v3/projects/6caa3ad4a4dc48efbd2ec452fe2d7fd3/users/10c1a86fb8da4c42ab322b70327e813c/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:13.238516 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462956c-39d1-4ece-ac9a-e0b604dec2f1 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.238748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462956c-39d1-4ece-ac9a-e0b604dec2f1 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.239051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462956c-39d1-4ece-ac9a-e0b604dec2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.265437 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3462956c-39d1-4ece-ac9a-e0b604dec2f1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:13.267131 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3462956c-39d1-4ece-ac9a-e0b604dec2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:13.337455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1230/2448] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:13.348499 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:13.351005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:13.417732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0aca-82e8-4dc4-b39e-b22de1992b41 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:13.421860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:13.422510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:13.422786 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:13.423052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:13.436310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:13.438457 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:13.453116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1219/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:14.137588 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631291ed-8e31-4b24-99ec-0eb675ef492a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:14.138170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631291ed-8e31-4b24-99ec-0eb675ef492a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:14.138170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631291ed-8e31-4b24-99ec-0eb675ef492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:14.170766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-631291ed-8e31-4b24-99ec-0eb675ef492a None None] MFA Rules not processed for user `10c1a86fb8da4c42ab322b70327e813c`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:14.172082 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-631291ed-8e31-4b24-99ec-0eb675ef492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:14.251868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1231/2450] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:14.263335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:14.264769 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:14.333067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3a14-a3cd-48b1-be4e-eef5965a7359 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:14.338316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:14.338952 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:14.339224 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:14.339494 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:14.346253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:14.348613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:14.350611 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384aced-ca4d-40cc-a5a7-9eeac102bc02 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:14.361049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1220/2451] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:15.745287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:15.745914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:15.745914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:15.769673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] MFA Rules not processed for user `10c1a86fb8da4c42ab322b70327e813c`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:15.770912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:15.779113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1232/2452] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:24.362412 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:25.762795 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:30.445931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:30.446449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:30.446718 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:30.473249 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] MFA Rules not processed for user `10c1a86fb8da4c42ab322b70327e813c`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:30.474510 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:30.482660 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1221/2453] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:37.857309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:37.859371 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:38.104845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f4b8-00b8-424e-9e45-c0cf335a92f6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:38.111327 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:38.112781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:38.113217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:38.113658 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:38.116333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:38.131539 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:38.133121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:38.146267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1233/2454] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:56:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:40.466116 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:42.204173 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:42.247212 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15be0-6010-4a43-881f-0f16726b7161 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:42.254793 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:42.255451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:42.255734 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:42.256060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:42.259635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:42.272723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:42.274359 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:42.287883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1222/2455] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:56:43.898224 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:43.901234 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:43.984868 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd55af-71e0-4cd5-8dc2-7d90a83296eb service placement] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:43.989919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:43.990591 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:43.990870 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:43.991142 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] PATH_INFO: `/v3/users/c569da95153a4e6093664db915b0c588` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:43.992454 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c569da95153a4e6093664db915b0c588)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:43.994426 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:44.070419 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c569da95153a4e6093664db915b0c588'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.083117 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:44.092195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c569da95153a4e6093664db915b0c588'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.093111 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c569da95153a4e6093664db915b0c588'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.093934 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c569da95153a4e6093664db915b0c588'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.107513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c569da95153a4e6093664db915b0c588'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.129915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1234/2456] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:56:43 2022] DELETE /identity/v3/users/c569da95153a4e6093664db915b0c588 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:44.367468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:44.387890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba20b-8339-43f0-943e-6414eb486d0f service placement] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:44.500497 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:44.501504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:44.501949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:44.502253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] PATH_INFO: `/v3/projects/319b1093dfbe4285a60c0aea1cd6a502` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:44.503724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=319b1093dfbe4285a60c0aea1cd6a502)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:44.505923 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:44.609151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319b1093dfbe4285a60c0aea1cd6a502', 'request_id': 'req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.619906 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319b1093dfbe4285a60c0aea1cd6a502', 'request_id': 'req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.628646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319b1093dfbe4285a60c0aea1cd6a502', 'request_id': 'req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.642701 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] The token cache is being invalidate because project 319b1093dfbe4285a60c0aea1cd6a502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:56:44.643292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.644037 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.648620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1223/2457] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:56:44 2022] DELETE /identity/v3/projects/319b1093dfbe4285a60c0aea1cd6a502 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:44.653284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:44.655331 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:44.676089 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fc366-0acb-406c-919e-cc71c4a4e811 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:44.754985 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:44.756533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:44.756533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:44.756533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] PATH_INFO: `/v3/users/7952455fd4614645b4c05cf7cfe703ed` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:44.757648 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7952455fd4614645b4c05cf7cfe703ed)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:44.759651 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:44.830677 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7952455fd4614645b4c05cf7cfe703ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.843115 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7952455fd4614645b4c05cf7cfe703ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.844052 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7952455fd4614645b4c05cf7cfe703ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.845207 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7952455fd4614645b4c05cf7cfe703ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.856552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-4b4680ed-763f-4b06-92e2-a167ca6a140f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7952455fd4614645b4c05cf7cfe703ed'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:44.882162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1235/2458] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:56:44 2022] DELETE /identity/v3/users/7952455fd4614645b4c05cf7cfe703ed => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:45.121347 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:45.124213 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:45.151123 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c62d0-0e01-4f29-8861-b8a0f024f72e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:45.240579 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:45.241574 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:45.242444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:45.242444 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] PATH_INFO: `/v3/projects/86580f588a82435ebed0c0204e931c43` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:45.243873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86580f588a82435ebed0c0204e931c43)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:45.245809 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:45.248641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:45.318698 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86580f588a82435ebed0c0204e931c43', 'request_id': 'req-3b4e28bd-6106-4e44-9915-1759b4e80d6f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:45.330691 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86580f588a82435ebed0c0204e931c43', 'request_id': 'req-3b4e28bd-6106-4e44-9915-1759b4e80d6f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:45.340794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86580f588a82435ebed0c0204e931c43', 'request_id': 'req-3b4e28bd-6106-4e44-9915-1759b4e80d6f'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:45.357733 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] The token cache is being invalidate because project 86580f588a82435ebed0c0204e931c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:56:45.358099 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:45.358771 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-3b4e28bd-6106-4e44-9915-1759b4e80d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:56:45.360481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1224/2459] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:56:45 2022] DELETE /identity/v3/projects/86580f588a82435ebed0c0204e931c43 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:56:46.867487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:46.868166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:46.868166 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:46.896051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] MFA Rules not processed for user `789019238c674e5288cd2770dc75ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:46.897421 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:46.945150 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:46.964897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1236/2460] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:49.210133 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d08-b250-4d81-b129-addeac30dbcb None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:49.210715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d08-b250-4d81-b129-addeac30dbcb None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:49.211035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d08-b250-4d81-b129-addeac30dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:49.250789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f43a9d08-b250-4d81-b129-addeac30dbcb None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:56:49.252478 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f43a9d08-b250-4d81-b129-addeac30dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:49.356343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1225/2461] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Oct 15 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:56:49.424874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:56:49.426864 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:56:49.539312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76f50f-2642-464f-935c-b670cf92a7c6 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:56:49.546797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:56:49.547455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:56:49.547738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:56:49.548088 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:56:49.563217 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:56:49.565027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:56:49.576010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1237/2462] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 13:56:59.343017 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:59.570606 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=37 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:06.163424 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:06.164008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:06.164008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:06.183945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] MFA Rules not processed for user `560f0a24a22f40048578a6e9ffb36927`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:06.185214 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:06.193063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1226/2463] 10.222.0.33 () {58 vars in 967 bytes} [Sat Oct 15 13:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:06.205909 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:06.221627 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02bd63-b0be-4e18-b244-3bb2137b0d15 service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:06.229892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc00888b1344a4fbc4fb5fd383791ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:06.230510 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:06.230789 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:06.231065 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:06.240402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:06.242022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:06.250582 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1238/2464] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Oct 15 13:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 13:57:08.347561 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:08.349220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:08.422692 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e2b8-aa32-4e8c-9ac6-b54d74d9bf62 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:08.429317 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:08.429974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:08.430263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:08.430617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] PATH_INFO: `/v3/users/10c1a86fb8da4c42ab322b70327e813c` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:08.432527 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c1a86fb8da4c42ab322b70327e813c)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:08.434549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:08.499167 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c1a86fb8da4c42ab322b70327e813c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.512334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c1a86fb8da4c42ab322b70327e813c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.513188 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c1a86fb8da4c42ab322b70327e813c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.513934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c1a86fb8da4c42ab322b70327e813c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.525080 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-675da0c9-e0fe-4b2b-8eba-6308bc77d596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c1a86fb8da4c42ab322b70327e813c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.550456 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1227/2465] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:57:08 2022] DELETE /identity/v3/users/10c1a86fb8da4c42ab322b70327e813c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:57:08.772105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:08.788794 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d1b1-e4db-4819-b52c-0beb6e28f086 service swift] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:08.866549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:08.867485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:08.867485 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:08.867729 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] PATH_INFO: `/v3/projects/6caa3ad4a4dc48efbd2ec452fe2d7fd3` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:08.869291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caa3ad4a4dc48efbd2ec452fe2d7fd3)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:08.871373 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:08.925059 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caa3ad4a4dc48efbd2ec452fe2d7fd3', 'request_id': 'req-a4b71a83-c8c5-4c69-9cea-11149452dc3f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.931889 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caa3ad4a4dc48efbd2ec452fe2d7fd3', 'request_id': 'req-a4b71a83-c8c5-4c69-9cea-11149452dc3f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.942762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caa3ad4a4dc48efbd2ec452fe2d7fd3', 'request_id': 'req-a4b71a83-c8c5-4c69-9cea-11149452dc3f'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.955168 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] The token cache is being invalidate because project 6caa3ad4a4dc48efbd2ec452fe2d7fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:57:08.955448 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.956169 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-a4b71a83-c8c5-4c69-9cea-11149452dc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:57:08.957716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1239/2466] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:57:08 2022] DELETE /identity/v3/projects/6caa3ad4a4dc48efbd2ec452fe2d7fd3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:57:08.963985 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:08.964446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:08.964730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.037076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:09.038304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:09.079812 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:09.104003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1228/2467] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:09.112309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.112575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.112839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.136970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:09.138211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:09.151354 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1240/2468] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:09.156437 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.167250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69562d-eb84-4902-adf7-ba8521ff6ee1 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.172889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.173538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.173818 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.174094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.174772 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:57:09.175077 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.176792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.190343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1229/2469] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:57:09.194927 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.206036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe13867-d853-4de7-84d2-a1143a44a19c None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.213145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.213782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.214118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.214385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.215039 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.217228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.251429 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1241/2470] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:57:09 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:57:09.255865 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.269284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83483f1d-d763-4b01-b1ca-fde9aa7d2200 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.334787 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.335426 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.335679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.335997 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.336652 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.339221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.366802 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1230/2471] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:57:09 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:57:09.371537 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.383005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c3b0-c70b-47bd-af40-64e8601a111f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.388790 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.389413 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.389692 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.389931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.390583 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.392241 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.403624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1242/2472] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:57:09.408329 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.418851 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a09fa7-e45f-4e0e-a1fb-bc4009efcfda admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.423726 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.424373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.424646 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.424942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.425582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.427186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be4462-a49c-4a20-8073-d5fef7e8dcad admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.439737 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1231/2473] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:57:09.446309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.461737 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd202-7762-486b-bb70-c666b5a2c88f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.471158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.472174 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.472604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.472856 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] PATH_INFO: `/v3/projects/019b601acf334ea7bde5aa763a30d734/users/a6c84b8b10ae4961b6b23015a5dea908/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.491536 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019b601acf334ea7bde5aa763a30d734, user_id=a6c84b8b10ae4961b6b23015a5dea908, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.494706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.510975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1243/2474] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:57:09 2022] PUT /identity/v3/projects/019b601acf334ea7bde5aa763a30d734/users/a6c84b8b10ae4961b6b23015a5dea908/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:57:09.516296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010030-c74a-4df3-bd5c-5d08a25a406b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.516659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010030-c74a-4df3-bd5c-5d08a25a406b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.516934 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010030-c74a-4df3-bd5c-5d08a25a406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.540918 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-21010030-c74a-4df3-bd5c-5d08a25a406b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:09.542557 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-21010030-c74a-4df3-bd5c-5d08a25a406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:09.615314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1232/2475] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:09.626772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:09.628944 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:09.648742 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:09.725857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a6f4-f54b-4b74-8411-dff82cd41ba5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:09.729924 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:09.730549 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:09.730829 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:09.731098 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:09.747050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:09.748645 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:09.759954 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1244/2476] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:10.459848 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d6fc-800a-406d-b863-55498eb883f6 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:10.460423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d6fc-800a-406d-b863-55498eb883f6 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:10.460565 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d6fc-800a-406d-b863-55498eb883f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:10.495607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-2da9d6fc-800a-406d-b863-55498eb883f6 None None] MFA Rules not processed for user `a6c84b8b10ae4961b6b23015a5dea908`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:10.497104 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2da9d6fc-800a-406d-b863-55498eb883f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:10.546280 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:10.587829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1233/2477] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:10.599607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:10.601266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:10.690594 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82fdd-a878-4428-ba4b-58233198c6d4 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:10.694303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:10.694915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:10.695186 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:10.695452 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:10.704988 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:10.706616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550c909-0137-49c0-b8cc-024ce56f8fe5 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:10.716727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1245/2478] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:12.113006 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:12.113576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:12.113576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:12.133659 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] MFA Rules not processed for user `a6c84b8b10ae4961b6b23015a5dea908`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:12.134909 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:12.142926 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1234/2479] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:20.712294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=64 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:22.128514 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=13 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:37.574402 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233375d-c07d-4673-9752-fb38b53f2774 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:37.575033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233375d-c07d-4673-9752-fb38b53f2774 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:37.575033 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233375d-c07d-4673-9752-fb38b53f2774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:37.600533 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b233375d-c07d-4673-9752-fb38b53f2774 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:37.601770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b233375d-c07d-4673-9752-fb38b53f2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:37.610513 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1246/2480] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:37.627637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:37.630115 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:37.749636 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9239ef-291d-4e41-91a1-a1204e88fdfc None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:37.756136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:37.756776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:37.757060 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:37.757314 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:37.766648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:37.768298 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:37.779233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1235/2481] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:40.661646 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90619d-7789-4523-a3ea-222e9039c0db None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:40.662291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90619d-7789-4523-a3ea-222e9039c0db None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:40.662291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90619d-7789-4523-a3ea-222e9039c0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:40.685782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-be90619d-7789-4523-a3ea-222e9039c0db None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:40.687340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-be90619d-7789-4523-a3ea-222e9039c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:40.699091 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1247/2482] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:40.713239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:40.714866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:40.731844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717041d-67cf-4514-9a31-4e22e3753ec8 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:40.738051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:40.738684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:40.738967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:40.739328 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:40.749226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:40.750836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:40.761826 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1236/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:43.939385 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add268f0-6d39-452d-a787-80f0dbbfab79 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:43.940035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add268f0-6d39-452d-a787-80f0dbbfab79 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:43.940035 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add268f0-6d39-452d-a787-80f0dbbfab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:43.961986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-add268f0-6d39-452d-a787-80f0dbbfab79 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:43.963197 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-add268f0-6d39-452d-a787-80f0dbbfab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:43.972772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1248/2484] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:43.992397 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:44.011091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85620534-7d26-43a6-a8f2-bab5bb0a61b7 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:44.020798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:44.021465 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:44.021756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:44.022069 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:44.035596 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:44.037914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:44.048243 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1237/2485] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:47.036586 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eb39-d15e-4d4b-a6c2-fbcab2f7e456 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:47.037731 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eb39-d15e-4d4b-a6c2-fbcab2f7e456 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:47.037987 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9eb39-d15e-4d4b-a6c2-fbcab2f7e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:47.059670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ced9eb39-d15e-4d4b-a6c2-fbcab2f7e456 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:47.060923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ced9eb39-d15e-4d4b-a6c2-fbcab2f7e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:47.070609 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1249/2486] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:57:47.087431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:47.103670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd72c-2e09-48a1-a5b8-fb198c211aea service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:47.115648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:47.116358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:47.116643 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:47.116992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:47.128999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:47.130912 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:47.143689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1238/2487] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:50.225323 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c846a-e666-4dbf-904f-de81da1ca3e0 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:50.226062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c846a-e666-4dbf-904f-de81da1ca3e0 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:50.226062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c846a-e666-4dbf-904f-de81da1ca3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:50.249027 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-4a1c846a-e666-4dbf-904f-de81da1ca3e0 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:50.250980 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4a1c846a-e666-4dbf-904f-de81da1ca3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:50.263597 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1250/2488] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:50.281064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:50.293358 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc275-c945-4911-a82b-aab8d0cf50a6 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:50.301435 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:50.302241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:50.302522 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:50.302825 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:50.314165 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:50.316562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7130-fb0c-4c18-b65b-dff9d2523975 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:50.336002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1239/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:57:51.315661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:51.316369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:51.316369 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:51.337543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] MFA Rules not processed for user `789019238c674e5288cd2770dc75ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:51.338772 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:51.401196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1251/2490] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:53.407558 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b4f8-2394-4988-b2b2-ca036e8747b2 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:53.408279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b4f8-2394-4988-b2b2-ca036e8747b2 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:53.408560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b4f8-2394-4988-b2b2-ca036e8747b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:53.434575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c0a9b4f8-2394-4988-b2b2-ca036e8747b2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:57:53.435852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c0a9b4f8-2394-4988-b2b2-ca036e8747b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:57:53.444700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1240/2491] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:57:53.461892 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:57:53.475853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cb80-a151-4441-b7c6-978e29532b18 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:57:53.483678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:57:53.484251 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:57:53.484515 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:57:53.484855 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:57:53.494431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:57:53.496055 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9332-42b5-4c05-8a11-a02cb7089115 service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:57:53.507424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1252/2492] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:03.428525 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=70 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:03.502034 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=46 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:09.063302 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:09.063945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:09.063945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:09.085829 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] MFA Rules not processed for user `a6c84b8b10ae4961b6b23015a5dea908`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:09.087638 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:09.095759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1241/2493] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:58:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:19.080233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:21.472044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd7d1-5d1d-4071-abba-c112baaa2ae6 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:21.472741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd7d1-5d1d-4071-abba-c112baaa2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:21.472741 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd7d1-5d1d-4071-abba-c112baaa2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:21.497291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-d34cd7d1-5d1d-4071-abba-c112baaa2ae6 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:21.498554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d34cd7d1-5d1d-4071-abba-c112baaa2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:21.507728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1253/2494] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:21.522907 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:21.538187 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c5580-b5f1-49c9-aea9-49ff22133a09 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:21.545373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:21.546087 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:21.546475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:21.546746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:21.558538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:21.560186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:21.571523 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1242/2495] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:24.811684 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727aa8-d5f2-45d0-b0f8-f6472e9e865a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:24.812400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727aa8-d5f2-45d0-b0f8-f6472e9e865a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:24.812400 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727aa8-d5f2-45d0-b0f8-f6472e9e865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:24.834816 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-50727aa8-d5f2-45d0-b0f8-f6472e9e865a None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:24.836114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-50727aa8-d5f2-45d0-b0f8-f6472e9e865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:24.845674 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1254/2496] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:24.861620 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:24.874312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b8e7-ef47-4970-8590-790d2f27c57f service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:24.881189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:24.881874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:24.882189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:24.882582 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:24.892386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:24.894004 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:24.905833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1243/2497] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:27.904754 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b6db-1e06-431a-b146-5293adb306de None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:27.905361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b6db-1e06-431a-b146-5293adb306de None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:27.905361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b6db-1e06-431a-b146-5293adb306de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:27.926846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-f831b6db-1e06-431a-b146-5293adb306de None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:27.928244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-f831b6db-1e06-431a-b146-5293adb306de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:27.936886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1255/2498] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:27.952775 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:27.966655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c754d8-0bd0-4c2e-8a0a-f955a6a59234 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:27.972723 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:27.973391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:27.973661 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:27.973931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:27.983468 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:27.985135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:27.996595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1244/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:31.080550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f107-fedc-4969-a877-67683e65d807 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:31.081134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f107-fedc-4969-a877-67683e65d807 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:31.081346 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f107-fedc-4969-a877-67683e65d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:31.102853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5667f107-fedc-4969-a877-67683e65d807 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:31.104100 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5667f107-fedc-4969-a877-67683e65d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:31.113183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1256/2500] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:31.132413 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:31.144398 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec669b1-5f38-4599-9b6f-3a0c209b4b56 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:31.151429 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:31.152064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:31.152340 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:31.152607 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:31.161885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:31.163466 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:31.173451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1245/2501] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:34.281544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010d65-c596-4575-aada-245f413ce10d None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:34.282105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010d65-c596-4575-aada-245f413ce10d None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:34.282494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010d65-c596-4575-aada-245f413ce10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:34.309050 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-63010d65-c596-4575-aada-245f413ce10d None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:58:34.310286 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-63010d65-c596-4575-aada-245f413ce10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:34.320240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1257/2502] 10.222.0.25 () {58 vars in 1016 bytes} [Sat Oct 15 13:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:58:34.337983 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:34.352764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc751-004c-4a95-9440-24d6a33916f9 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:34.360334 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:34.360933 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:34.361208 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:34.361481 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:34.370834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:34.372461 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:34.381999 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1246/2503] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:58:44.302961 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=15 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:44.377631 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=30 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:59.869230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010d65-c596-4575-aada-245f413ce10d None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:59.870836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-63010d65-c596-4575-aada-245f413ce10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:59.933573 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:58:59.935297 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:59.952905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c698-b043-41f6-a1aa-01f0efa9ba76 service nova] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:59.957575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:59.958206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:59.958479 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:59.958746 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] PATH_INFO: `/v3/users/789019238c674e5288cd2770dc75ad97` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:59.959917 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789019238c674e5288cd2770dc75ad97)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:59.961806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:59.962196 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010d65-c596-4575-aada-245f413ce10d None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:58:59.967289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:58:59.967974 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:58:59.968254 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:58:59.968526 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:58:59.970332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:58:59.982483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:58:59.984257 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:58:59.995372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1258/2504] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:00.011644 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789019238c674e5288cd2770dc75ad97'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.021326 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789019238c674e5288cd2770dc75ad97'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.022083 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789019238c674e5288cd2770dc75ad97'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.023052 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789019238c674e5288cd2770dc75ad97'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.034237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-83fa1386-157d-458e-a408-816bff311667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789019238c674e5288cd2770dc75ad97'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.056475 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1247/2505] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:58:59 2022] DELETE /identity/v3/users/789019238c674e5288cd2770dc75ad97 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:00.250689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.263013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45675-b26a-40e5-b03f-fc16995e7e41 service placement] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.340053 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.341020 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.341450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.341843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] PATH_INFO: `/v3/projects/0656d95f47824bfa89c2dd1ccbc91cce` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.343041 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0656d95f47824bfa89c2dd1ccbc91cce)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.344982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.396995 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0656d95f47824bfa89c2dd1ccbc91cce', 'request_id': 'req-e964da26-aedc-4779-b6e0-9dbc4b913509'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.403696 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0656d95f47824bfa89c2dd1ccbc91cce', 'request_id': 'req-e964da26-aedc-4779-b6e0-9dbc4b913509'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.413280 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0656d95f47824bfa89c2dd1ccbc91cce', 'request_id': 'req-e964da26-aedc-4779-b6e0-9dbc4b913509'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.425395 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] The token cache is being invalidate because project 0656d95f47824bfa89c2dd1ccbc91cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:00.425699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.426379 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-e964da26-aedc-4779-b6e0-9dbc4b913509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:00.428538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1259/2506] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:00 2022] DELETE /identity/v3/projects/0656d95f47824bfa89c2dd1ccbc91cce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:00.434204 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.434554 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.434886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.457159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:00.458521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:00.534375 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1248/2507] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:00.545180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.545662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.546210 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.567774 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:00.569093 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:00.577531 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1260/2508] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:59:00.583598 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.596268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b09230-a3ca-469c-8b3d-18a5403e784b None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.603987 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.604808 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.605084 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.605425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.606195 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:59:00.606550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.609233 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.622724 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1249/2509] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:59:00.628943 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.640767 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b457-2432-4e75-8a79-f1005f0a6d17 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.646478 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.647134 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.647765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.648077 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.648726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.650639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.663322 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:00.697633 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1261/2510] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:00 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:59:00.702196 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.712975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4ced1-404a-4d96-9b4f-8e363656549f admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.773592 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.774207 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.774483 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.774762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.775403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.777373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.785658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:00.802629 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1250/2511] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:00 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:00.806939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.818288 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0d9f-e3e9-4eb9-9a6d-694ceb59bc29 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.824051 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.824675 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.824938 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.825372 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.826473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.828240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.839779 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1262/2512] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:59:00.844668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.858800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2a6e-2d94-446b-ab0d-6b074b8b9e0c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.863732 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.864360 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.864635 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.864901 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.865532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.867124 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a101c09-9da8-41a2-a93a-5bc5b2134344 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.878506 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1251/2513] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:00.884834 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:00.895493 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c348-ec23-4402-93b1-968f87cb2678 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:00.901451 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:00.902304 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.902461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.902744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] PATH_INFO: `/v3/projects/885ef460a3fd4dd7b4c1a3662826c2ad/users/676626c038c042a49fb87d9d3e36ea4c/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.918096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885ef460a3fd4dd7b4c1a3662826c2ad, user_id=676626c038c042a49fb87d9d3e36ea4c, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:00.920845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:00.937461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1263/2514] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:00 2022] PUT /identity/v3/projects/885ef460a3fd4dd7b4c1a3662826c2ad/users/676626c038c042a49fb87d9d3e36ea4c/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:00.949151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:00.949641 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:00.949740 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:00.980501 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] MFA Rules not processed for user `676626c038c042a49fb87d9d3e36ea4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:00.981700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.053537 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1252/2515] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:01.068956 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:01.070869 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.145300 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2eddd-90b9-4a18-8bff-f5adede119d6 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:01.151955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10284800d0248778a9b4ece037e3343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:01.152572 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:01.152846 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:01.153113 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:01.165971 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:01.168443 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:01.181446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1264/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:01.266632 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:01.268168 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.333181 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eda893-5a1f-4890-b1d1-68605b34fc92 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:01.337079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:01.337681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:01.337957 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:01.338225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:01.340751 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.355210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:01.356682 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023c60e-9977-4924-be11-c2015dc8d75a service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:01.371305 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1253/2517] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:59:01.517970 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:01.588694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafed9c-723a-4d55-9814-4013d2776efb service nova] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:01.595595 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:01.596918 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:01.597563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:01.598404 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] PATH_INFO: `/v3/users/676626c038c042a49fb87d9d3e36ea4c` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:01.601723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=676626c038c042a49fb87d9d3e36ea4c)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:01.605730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:01.674546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:01.689159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676626c038c042a49fb87d9d3e36ea4c'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:01.697159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676626c038c042a49fb87d9d3e36ea4c'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:01.697947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676626c038c042a49fb87d9d3e36ea4c'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:01.698558 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676626c038c042a49fb87d9d3e36ea4c'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:01.707910 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676626c038c042a49fb87d9d3e36ea4c'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:01.739886 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1265/2518] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:01 2022] DELETE /identity/v3/users/676626c038c042a49fb87d9d3e36ea4c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:01.748603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:01.748886 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:01.749288 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:01.784226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:01.785831 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.863225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1254/2519] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:01.873719 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:01.875287 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:01.939770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7777-20fb-424f-aec1-104d57a38397 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:01.943888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:01.945266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:01.945266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:01.945266 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:01.956708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:01.958568 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd2fc6-87a0-4b6d-ba13-f552ffe67681 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:01.969807 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1266/2520] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:59:02.265854 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.267418 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:02.280820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d83df-1693-40f4-a4dc-f4f30cab6d03 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.285684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.286335 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.286613 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.286883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] PATH_INFO: `/v3/projects/885ef460a3fd4dd7b4c1a3662826c2ad` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.288029 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] RBAC: Authorizing `identity:delete_project(project_id=885ef460a3fd4dd7b4c1a3662826c2ad)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.289963 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.298627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:02.345603 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885ef460a3fd4dd7b4c1a3662826c2ad', 'request_id': 'req-c09050c0-8606-4133-9e7e-e90f9f35634d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:02.354516 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885ef460a3fd4dd7b4c1a3662826c2ad', 'request_id': 'req-c09050c0-8606-4133-9e7e-e90f9f35634d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:02.361706 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885ef460a3fd4dd7b4c1a3662826c2ad', 'request_id': 'req-c09050c0-8606-4133-9e7e-e90f9f35634d'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:02.372108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] The token cache is being invalidate because project 885ef460a3fd4dd7b4c1a3662826c2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:02.372379 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:02.373431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-c09050c0-8606-4133-9e7e-e90f9f35634d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:02.374889 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1255/2521] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:02 2022] DELETE /identity/v3/projects/885ef460a3fd4dd7b4c1a3662826c2ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:02.380073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.380380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.380636 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.403267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:02.404639 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:02.475338 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1267/2522] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:02.484062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.484344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.484616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.507027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:02.508312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:02.518408 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1256/2523] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:02.523467 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.534203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7232e9-7bff-481a-8711-741b50bcb362 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.539544 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.540220 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.540504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.541490 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.542165 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:59:02.542465 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.544121 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.556718 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1268/2524] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 13:59:02.561617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.571136 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf904a1-6848-465f-a459-92f6bd7a8798 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.576577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.577189 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.577462 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.577725 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.578357 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.580308 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.614587 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1257/2525] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:02 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:02.620225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.631950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfaf9-22f9-4a69-a571-b5b41e872818 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.686762 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:02.713198 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.714463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.714888 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.715314 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.716440 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.719911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.752102 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1269/2526] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:02 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:02.753402 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.764403 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3d11-fa3b-40cc-92ed-7af7db63975c admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.769247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.769967 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.770324 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.770681 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.771373 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.773368 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.787495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1258/2527] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:59:02.789561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.800962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246747c-f652-4738-8a15-306f38f7dd66 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.806180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.806825 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.807104 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.807380 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.808078 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.809740 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cb921-206e-4e9e-8130-aa945b14524f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.823853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1270/2528] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:02.825800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:02.836735 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490616d0-836d-4f40-9288-95ba3274abb9 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:02.842572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:02.843477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.843764 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.844076 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] PATH_INFO: `/v3/projects/7c1b3d1e188c4e33b50dbea20a48acd0/users/2d6d5b77803d47a8a533599947bec706/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.863128 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1b3d1e188c4e33b50dbea20a48acd0, user_id=2d6d5b77803d47a8a533599947bec706, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:02.866237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:02.881440 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1259/2529] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:02 2022] PUT /identity/v3/projects/7c1b3d1e188c4e33b50dbea20a48acd0/users/2d6d5b77803d47a8a533599947bec706/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:02.893261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:02.893546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:02.893847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:02.927525 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] MFA Rules not processed for user `2d6d5b77803d47a8a533599947bec706`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:02.929066 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.011520 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1271/2530] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:03.013286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.099696 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a066b31-a296-474b-8602-e8a2f2ee953b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.105245 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.105867 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.106144 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.106410 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.107487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.109562 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.141285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1260/2531] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:03 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:03.145447 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.159307 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b974e1-3969-4a8b-999d-ec22243fdf3b None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.228704 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.229340 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.229607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.229902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.230552 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.233238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.253950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.256543 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.268432 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1272/2532] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:03 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:03.272852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669878-acc2-48f5-873e-7312b87f7845 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.273330 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.278273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.279131 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.279593 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.279902 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] PATH_INFO: `/v3/users/a6c84b8b10ae4961b6b23015a5dea908` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.281159 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c84b8b10ae4961b6b23015a5dea908)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.282963 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704565-381c-4e6c-8697-6307583b3166 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.283110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.287612 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.288337 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.288519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.288796 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.290002 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.291028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.295564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:03.302483 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1273/2533] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:59:03.306797 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.317753 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678cd2e-c89b-42d3-8381-2ba0d97f724e admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.323913 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.324629 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.325046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.325333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] PATH_INFO: `/v3/projects/698b6084c3cc45a9bd340a4f159cc09e/users/23d8b20cb54f43d1a8df0b1f80f7eeac/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.338801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c84b8b10ae4961b6b23015a5dea908'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.342446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698b6084c3cc45a9bd340a4f159cc09e, user_id=23d8b20cb54f43d1a8df0b1f80f7eeac, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.345162 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.346003 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c84b8b10ae4961b6b23015a5dea908'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.346668 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c84b8b10ae4961b6b23015a5dea908'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.347272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c84b8b10ae4961b6b23015a5dea908'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.355890 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c84b8b10ae4961b6b23015a5dea908'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.359835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1274/2534] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:03 2022] PUT /identity/v3/projects/698b6084c3cc45a9bd340a4f159cc09e/users/23d8b20cb54f43d1a8df0b1f80f7eeac/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:03.364228 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.366019 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.372392 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:03.374781 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1261/2535] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:03 2022] DELETE /identity/v3/users/a6c84b8b10ae4961b6b23015a5dea908 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:03.436902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894aebf-d7b5-4c34-a11a-824bca722272 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.497107 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.497866 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.498137 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.498497 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.499164 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.500800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.511707 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1275/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:03.515449 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.526203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3c45-9bff-4565-802e-b680a52eb151 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.531044 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.531768 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.532107 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.532381 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] PATH_INFO: `/v3/projects/698b6084c3cc45a9bd340a4f159cc09e/users/23d8b20cb54f43d1a8df0b1f80f7eeac/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.534304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698b6084c3cc45a9bd340a4f159cc09e, user_id=23d8b20cb54f43d1a8df0b1f80f7eeac, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.537035 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d0d2-d687-418b-b774-89f6f7eaef94 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.560167 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.562085 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1262/2537] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:03 2022] PUT /identity/v3/projects/698b6084c3cc45a9bd340a4f159cc09e/users/23d8b20cb54f43d1a8df0b1f80f7eeac/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:03.562575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.564198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.564504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.564792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.582550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ddee-c3bb-4d2a-8610-33aa7a1cc48f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.607683 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] MFA Rules not processed for user `23d8b20cb54f43d1a8df0b1f80f7eeac`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:03.608977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.648876 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.649550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.649832 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.650123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] PATH_INFO: `/v3/projects/019b601acf334ea7bde5aa763a30d734` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.651309 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019b601acf334ea7bde5aa763a30d734)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.653284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.695744 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1263/2538] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:03.704025 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019b601acf334ea7bde5aa763a30d734', 'request_id': 'req-aee9733b-a600-4081-ae1f-6232a98d5570'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.705189 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:03.709190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:03.712051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.714386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019b601acf334ea7bde5aa763a30d734', 'request_id': 'req-aee9733b-a600-4081-ae1f-6232a98d5570'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.724505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019b601acf334ea7bde5aa763a30d734', 'request_id': 'req-aee9733b-a600-4081-ae1f-6232a98d5570'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.736862 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] The token cache is being invalidate because project 019b601acf334ea7bde5aa763a30d734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:03.737185 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.737840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:03.739637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1276/2539] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:03 2022] DELETE /identity/v3/projects/019b601acf334ea7bde5aa763a30d734 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:03.784291 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fcb96-eb31-4f30-8534-1d831c33f38b None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:03.801924 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:03.852539 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:03.853220 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:03.853502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:03.853785 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:03.862111 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:03.941572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:03.943079 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:03.954650 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1264/2540] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:59:04.006819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:04.009064 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:04.027303 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9733b-a600-4081-ae1f-6232a98d5570 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:04.031745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:04.032386 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:04.032662 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:04.032930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:04.034761 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:04.100264 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:04.101716 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929b1ad-039a-4bec-ae76-8ff2977cbbf9 service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:04.111782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1277/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:07.554292 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:07.556005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:07.633505 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74917273-07d2-44fd-8ced-e0498ce0f4cf service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:07.638279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:07.639493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:07.639773 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:07.640078 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] PATH_INFO: `/v3/users/2d6d5b77803d47a8a533599947bec706` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:07.641247 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6d5b77803d47a8a533599947bec706)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:07.643223 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:07.704550 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6d5b77803d47a8a533599947bec706'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:07.720014 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6d5b77803d47a8a533599947bec706'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:07.721563 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6d5b77803d47a8a533599947bec706'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:07.722648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6d5b77803d47a8a533599947bec706'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:07.735108 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6d5b77803d47a8a533599947bec706'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:07.741318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:07.760225 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1265/2542] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:07 2022] DELETE /identity/v3/users/2d6d5b77803d47a8a533599947bec706 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:07.765547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:07.766422 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:07.766589 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:07.789820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:07.791123 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:07.874587 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1278/2543] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:07.886234 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:07.888027 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:07.951866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89946de3-f2b0-4224-a1ce-e39722501a54 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:07.955756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:07.956487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:07.956774 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:07.957049 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:07.967428 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:07.968986 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:07.979637 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1266/2544] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:08.288349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:08.289867 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:08.303819 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9075b-bed8-4276-8462-9eecd7567ad8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:08.309269 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:08.309950 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:08.310239 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:08.310524 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] PATH_INFO: `/v3/projects/7c1b3d1e188c4e33b50dbea20a48acd0` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:08.311824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1b3d1e188c4e33b50dbea20a48acd0)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:08.313986 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:08.380013 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1b3d1e188c4e33b50dbea20a48acd0', 'request_id': 'req-881ecd89-684e-43f1-b91f-049680d60fc3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.390472 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1b3d1e188c4e33b50dbea20a48acd0', 'request_id': 'req-881ecd89-684e-43f1-b91f-049680d60fc3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.403424 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1b3d1e188c4e33b50dbea20a48acd0', 'request_id': 'req-881ecd89-684e-43f1-b91f-049680d60fc3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.413067 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:08.417575 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] The token cache is being invalidate because project 7c1b3d1e188c4e33b50dbea20a48acd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:08.418218 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.419810 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.421979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1279/2545] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:08 2022] DELETE /identity/v3/projects/7c1b3d1e188c4e33b50dbea20a48acd0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:08.426939 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:08.439174 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a848-b80b-4add-bd31-78e596f489d8 service neutron] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:08.505653 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:08.506310 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:08.506590 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:08.506866 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] PATH_INFO: `/v3/users/23d8b20cb54f43d1a8df0b1f80f7eeac` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:08.508075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d8b20cb54f43d1a8df0b1f80f7eeac)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:08.510033 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:08.567947 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d8b20cb54f43d1a8df0b1f80f7eeac'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.575338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d8b20cb54f43d1a8df0b1f80f7eeac'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.576179 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d8b20cb54f43d1a8df0b1f80f7eeac'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.576783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d8b20cb54f43d1a8df0b1f80f7eeac'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.586038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-4b4c22f8-1f8a-44de-833b-5d3f62142a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d8b20cb54f43d1a8df0b1f80f7eeac'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:08.607824 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1267/2546] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:08 2022] DELETE /identity/v3/users/23d8b20cb54f43d1a8df0b1f80f7eeac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:08.953481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:08.955231 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:08.970481 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ecd89-684e-43f1-b91f-049680d60fc3 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.076982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.077840 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.078158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.078500 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] PATH_INFO: `/v3/projects/698b6084c3cc45a9bd340a4f159cc09e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.080213 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698b6084c3cc45a9bd340a4f159cc09e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.082891 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.150201 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698b6084c3cc45a9bd340a4f159cc09e', 'request_id': 'req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:09.158014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698b6084c3cc45a9bd340a4f159cc09e', 'request_id': 'req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:09.168203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698b6084c3cc45a9bd340a4f159cc09e', 'request_id': 'req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:09.180854 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] The token cache is being invalidate because project 698b6084c3cc45a9bd340a4f159cc09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:09.181148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:09.181839 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-6ff6219a-5bec-4f70-bf8a-7c6b23721fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:09.183384 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1280/2547] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:08 2022] DELETE /identity/v3/projects/698b6084c3cc45a9bd340a4f159cc09e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:09.189498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.189783 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.190057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.204827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:09.212316 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:09.215038 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:09.295206 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1268/2548] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:09.306758 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.307043 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.307318 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.330873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:09.332145 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:09.342688 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1281/2549] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:09.348776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.359250 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629f17d-6af4-419d-943e-c1258440eaef None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.364864 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.365513 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.365794 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.366065 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.366738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:59:09.367048 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.368756 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.383032 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1269/2550] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:59:09.387935 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.398949 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340e276-5edf-46c7-be36-d9411fc4f7f8 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.404215 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.405105 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.405388 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.405660 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.406328 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.408334 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.442319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1282/2551] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:09.447054 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.458198 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca60e2-8cdc-4557-97cb-98a1e75cfa89 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.520747 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.521433 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.522088 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.522391 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.523063 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.525094 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.549700 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1270/2552] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:59:09.555883 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.567172 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d418de-9333-4a8e-9ae9-e301afa232af admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.572915 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.573547 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.573824 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.574095 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.574748 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.576492 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.587396 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1283/2553] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:59:09.592009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.606315 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15f27-3a50-41d7-99fc-c788b350defe admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.613480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.614270 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.614594 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.614916 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.615776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.618384 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b3a1f-d600-4fce-ac43-5a94cdeaea40 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.631990 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1271/2554] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:09.636745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.648543 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492978-9afe-4fdf-8b82-81da59883797 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.653461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.654144 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.654487 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.654689 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] PATH_INFO: `/v3/projects/569c7e38ba1c42068041dcd7238fd8bf/users/7be9a1994ded4668b475dfaad7ad531e/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.672202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569c7e38ba1c42068041dcd7238fd8bf, user_id=7be9a1994ded4668b475dfaad7ad531e, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.674907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.692994 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1284/2555] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:09 2022] PUT /identity/v3/projects/569c7e38ba1c42068041dcd7238fd8bf/users/7be9a1994ded4668b475dfaad7ad531e/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:09.704455 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.704903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.705226 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.744156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] MFA Rules not processed for user `7be9a1994ded4668b475dfaad7ad531e`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:09.745407 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:09.821855 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1272/2556] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:09.827503 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.861912 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:09.901920 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e0c0-35d7-42c3-8ba7-9aacf1c6f114 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:09.907044 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:09.907608 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:09.907921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:09.908202 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:09.908859 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:09.910805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:09.944881 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1285/2557] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:09.949210 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:09.954860 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:09.962498 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a0f6-db14-4cd9-b8de-53a073fd1388 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.034439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.035075 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.035352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.035610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.036306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.038274 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.068504 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1273/2558] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:09 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:10.073802 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.092439 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871970-9fbb-42bd-8d35-fc27d11ff559 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.097442 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.098081 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.098366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.098649 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.099308 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.100981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.117519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1286/2559] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:10.119482 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.132091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b3d9-6ccf-4144-b449-838bb6e03ddd admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.137697 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.138471 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.138874 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.139268 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.140058 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.141800 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5c3b8-51bf-430e-a0ad-229f35b94f1f admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.155156 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1274/2560] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 13:59:10.158849 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.170592 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c445be-1792-4f7c-8ddd-0df4ed7d2a9c admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.175604 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.176339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.176619 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.176895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] PATH_INFO: `/v3/projects/7078af32469a49b2b1cab0d69474c06a/users/ce42eb704b604056a1e5b7c8045a7934/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.194678 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7078af32469a49b2b1cab0d69474c06a, user_id=ce42eb704b604056a1e5b7c8045a7934, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.197405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.218061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1287/2561] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:10 2022] PUT /identity/v3/projects/7078af32469a49b2b1cab0d69474c06a/users/ce42eb704b604056a1e5b7c8045a7934/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:10.230443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.230791 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.230998 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.264810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] MFA Rules not processed for user `ce42eb704b604056a1e5b7c8045a7934`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:10.266300 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:10.348344 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1275/2562] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:59:10.353378 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.426049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6a37-c8c3-4b81-86aa-b96359617f81 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.430993 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.431616 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.431930 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.432203 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] PATH_INFO: `/v3/projects` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.432861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.434786 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.465730 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1288/2563] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:10 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 13:59:10.471859 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.484129 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f2b5-039e-4063-9d13-466e0a6b1cee None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.548805 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.549443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.549716 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.550118 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.550833 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.552801 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.572715 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:10.579082 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1276/2564] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:10 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:10.582998 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.593853 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d18-6e2e-48f5-bc17-5dbcc3b09222 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.605415 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.606263 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.612062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.612062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.612062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.612062 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.624017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1289/2565] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:10.628795 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.640221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5aae4-9402-4251-9ac5-5d9c962638f2 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.647091 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.647765 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.648073 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.648730 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] PATH_INFO: `/v3/projects/1e7241f7341d4743a429419ac670c32c/users/f13f29bc699e47d58f184bc7eb765dfe/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.666655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7241f7341d4743a429419ac670c32c, user_id=f13f29bc699e47d58f184bc7eb765dfe, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.669469 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.686591 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1277/2566] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:10 2022] PUT /identity/v3/projects/1e7241f7341d4743a429419ac670c32c/users/f13f29bc699e47d58f184bc7eb765dfe/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:10.690765 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.705229 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0c66f-9c3e-4b6b-bfd3-dc97b90601f7 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.771119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:10.782908 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.783540 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.783845 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.784119 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.784782 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.786411 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85e1ae-8b55-43ff-bec2-1247660f6b86 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.797781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1290/2567] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:10.802873 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.814259 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac4c-a436-4ba4-860b-4fe7f1513d8e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:10.820015 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:10.820702 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.820978 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.821242 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] PATH_INFO: `/v3/projects/1e7241f7341d4743a429419ac670c32c/users/f13f29bc699e47d58f184bc7eb765dfe/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.823346 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7241f7341d4743a429419ac670c32c, user_id=f13f29bc699e47d58f184bc7eb765dfe, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:10.826810 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:10.838922 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1278/2568] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:10 2022] PUT /identity/v3/projects/1e7241f7341d4743a429419ac670c32c/users/f13f29bc699e47d58f184bc7eb765dfe/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:10.849838 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:10.850122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:10.850409 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:10.880366 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] MFA Rules not processed for user `f13f29bc699e47d58f184bc7eb765dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:10.881621 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:10.956852 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1291/2569] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:10.969021 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:10.971025 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:11.041616 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c1c3-8c21-4cb6-9e05-4571efe7e7a1 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:11.047634 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:11.048279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:11.048564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:11.048834 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:11.059495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:11.061009 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:11.071184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1279/2570] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 13:59:11.633800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:11.635623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:11.653480 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e15d-d1d0-409c-84e8-f060c2c887b9 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:11.657835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:11.658435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:11.658708 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:11.658975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:11.723702 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:11.725195 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:11.734623 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1292/2571] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:16.076517 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:16.086885 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaada-a39c-45b3-b34b-d0d63c63a48e service cinder] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:16.091416 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:16.092105 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:16.092387 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:16.092658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:16.159576 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:16.161097 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b566b6-1efb-4d88-9931-109afdb045fb service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:16.171974 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1280/2572] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:18.401699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:18.473895 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a306db-018e-4d57-87cf-9ef0aa3227ab service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:18.478560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:18.479361 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:18.479502 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:18.479739 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] PATH_INFO: `/v3/users/7be9a1994ded4668b475dfaad7ad531e` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:18.480919 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be9a1994ded4668b475dfaad7ad531e)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:18.482858 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:18.497073 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:18.538355 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be9a1994ded4668b475dfaad7ad531e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:18.547848 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be9a1994ded4668b475dfaad7ad531e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:18.548585 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be9a1994ded4668b475dfaad7ad531e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:18.549225 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be9a1994ded4668b475dfaad7ad531e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:18.561831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be9a1994ded4668b475dfaad7ad531e'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:18.583412 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1293/2573] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:18 2022] DELETE /identity/v3/users/7be9a1994ded4668b475dfaad7ad531e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:18.589761 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:18.590251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:18.590390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:18.611564 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:18.612827 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:18.683218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1281/2574] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:18.693989 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:18.695463 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:18.761332 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9393-2b1b-4fae-aef5-dafeddaf0b3b admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:18.765289 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:18.765990 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:18.766274 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:18.766546 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:18.777056 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:18.778522 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:18.790333 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1294/2575] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:19.096992 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:19.099008 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:19.110521 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:19.116051 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabca4f-9c66-49bc-b0d6-fb1ea1d8ab66 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:19.123503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:19.124273 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:19.124837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:19.124837 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] PATH_INFO: `/v3/projects/569c7e38ba1c42068041dcd7238fd8bf` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:19.126135 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569c7e38ba1c42068041dcd7238fd8bf)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:19.128154 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:19.177679 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569c7e38ba1c42068041dcd7238fd8bf', 'request_id': 'req-ca415dc8-5547-405f-bb7f-a05864148225'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.187218 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569c7e38ba1c42068041dcd7238fd8bf', 'request_id': 'req-ca415dc8-5547-405f-bb7f-a05864148225'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.194689 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569c7e38ba1c42068041dcd7238fd8bf', 'request_id': 'req-ca415dc8-5547-405f-bb7f-a05864148225'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.205841 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] The token cache is being invalidate because project 569c7e38ba1c42068041dcd7238fd8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:19.206140 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.206823 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.208396 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1282/2576] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:19 2022] DELETE /identity/v3/projects/569c7e38ba1c42068041dcd7238fd8bf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:19.213792 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:19.225964 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77b24-3d83-49f6-b2fc-7733cd423ac4 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:19.291914 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:19.292559 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:19.292835 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:19.293103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] PATH_INFO: `/v3/users/ce42eb704b604056a1e5b7c8045a7934` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:19.294261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce42eb704b604056a1e5b7c8045a7934)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:19.296560 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:19.339911 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:19.361580 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce42eb704b604056a1e5b7c8045a7934'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.369727 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce42eb704b604056a1e5b7c8045a7934'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.370460 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce42eb704b604056a1e5b7c8045a7934'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.371086 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce42eb704b604056a1e5b7c8045a7934'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.381861 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce42eb704b604056a1e5b7c8045a7934'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.406705 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1295/2577] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:19 2022] DELETE /identity/v3/users/ce42eb704b604056a1e5b7c8045a7934 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:19.714762 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:19.716495 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:19.737852 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dc8-5547-405f-bb7f-a05864148225 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:19.800544 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:19.801090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:19.801390 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:19.801657 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] PATH_INFO: `/v3/projects/7078af32469a49b2b1cab0d69474c06a` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:19.802838 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7078af32469a49b2b1cab0d69474c06a)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:19.804843 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:19.856331 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7078af32469a49b2b1cab0d69474c06a', 'request_id': 'req-0484eecc-bf4c-403c-b49a-4e4ea913bedb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.866378 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7078af32469a49b2b1cab0d69474c06a', 'request_id': 'req-0484eecc-bf4c-403c-b49a-4e4ea913bedb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.873191 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7078af32469a49b2b1cab0d69474c06a', 'request_id': 'req-0484eecc-bf4c-403c-b49a-4e4ea913bedb'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.884560 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] The token cache is being invalidate because project 7078af32469a49b2b1cab0d69474c06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:19.884844 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.885493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:19.886981 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1283/2578] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:19 2022] DELETE /identity/v3/projects/7078af32469a49b2b1cab0d69474c06a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:19.893036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:19.894598 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:19.911631 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b649eb-1c74-4ac0-9de9-5583a478e4f0 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:19.979902 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:19.980565 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:19.980843 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:19.981114 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] PATH_INFO: `/v3/users/f13f29bc699e47d58f184bc7eb765dfe` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:19.982305 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13f29bc699e47d58f184bc7eb765dfe)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:19.984459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:20.047170 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13f29bc699e47d58f184bc7eb765dfe'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.054706 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13f29bc699e47d58f184bc7eb765dfe'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.055349 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13f29bc699e47d58f184bc7eb765dfe'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.055982 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13f29bc699e47d58f184bc7eb765dfe'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.067389 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-d8636200-83c4-4b66-b685-93b1b4572d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13f29bc699e47d58f184bc7eb765dfe'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.088455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1296/2579] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:19 2022] DELETE /identity/v3/users/f13f29bc699e47d58f184bc7eb765dfe => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:20.388018 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:20.389474 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:20.405752 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484eecc-bf4c-403c-b49a-4e4ea913bedb admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:20.420369 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:20.471151 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:20.471806 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.472110 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.472431 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] PATH_INFO: `/v3/projects/1e7241f7341d4743a429419ac670c32c` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.473538 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7241f7341d4743a429419ac670c32c)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:20.475487 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:20.528119 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7241f7341d4743a429419ac670c32c', 'request_id': 'req-337117ac-12d4-40a0-b80a-9d46c225c53e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.538070 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7241f7341d4743a429419ac670c32c', 'request_id': 'req-337117ac-12d4-40a0-b80a-9d46c225c53e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.546648 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7241f7341d4743a429419ac670c32c', 'request_id': 'req-337117ac-12d4-40a0-b80a-9d46c225c53e'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.559086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] The token cache is being invalidate because project 1e7241f7341d4743a429419ac670c32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:20.559374 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.560068 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-337117ac-12d4-40a0-b80a-9d46c225c53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:20.561799 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1284/2580] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:20 2022] DELETE /identity/v3/projects/1e7241f7341d4743a429419ac670c32c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:20.568046 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.568577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.568577 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.589759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:20.590916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:20.621650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:20.660294 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1297/2581] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 13:59:20.730863 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.731451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.731451 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.754005 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:20.755241 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:20.764624 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1285/2582] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:20.769302 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:20.780083 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717c28-dc94-4703-b98c-cb8a2c1ea7fb None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:20.785703 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:20.786343 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.786607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.786874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.787538 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:59:20.787874 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:20.789519 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:20.803624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1298/2583] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:59:20.807680 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:20.817480 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f01f17-6ca0-4834-85f4-bf4f597ac7e5 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:20.822294 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:20.822905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.823184 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.823453 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.824130 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:20.826047 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:20.861086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1286/2584] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:20 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:20.862096 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:20.872823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc6d5-ea1f-43d1-a505-e1686a1b7978 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:20.940521 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:20.941473 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.941759 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.942028 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.942823 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:20.944735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:20.972181 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1299/2585] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:20 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:20.976584 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:20.988406 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36bdf-fd79-4213-9a85-4522b73b4662 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:20.994318 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:20.994946 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:20.995231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:20.995559 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:20.996248 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:20.997993 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.009477 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1287/2586] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:21.014017 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.025637 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedae95-3e32-4866-a588-3b0ef9254568 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.031679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.032325 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.032599 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.032847 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.033504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.035139 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773a8d-cc94-4d60-b016-3d6f76dadb02 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.048800 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1300/2587] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:21.055670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.069237 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807cf8-5b71-46ff-9092-bc19aa992709 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.074804 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.075476 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.075753 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.076057 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] PATH_INFO: `/v3/projects/4fd9c9b765494e2aac498ebd6c915ed7/users/f90152a6df85483a923af7370362c5f6/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.094931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd9c9b765494e2aac498ebd6c915ed7, user_id=f90152a6df85483a923af7370362c5f6, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.098386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.116293 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1288/2588] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:21 2022] PUT /identity/v3/projects/4fd9c9b765494e2aac498ebd6c915ed7/users/f90152a6df85483a923af7370362c5f6/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:21.128391 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.128673 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.128945 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.161563 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] MFA Rules not processed for user `f90152a6df85483a923af7370362c5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:21.162831 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:21.239979 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1301/2589] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:21.244705 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.295586 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:21.315186 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3806-2daa-403a-9fe8-312cfce5403b admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.320263 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.320977 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.321285 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.321595 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.322303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.325203 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.362883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1289/2590] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:21 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:21.367958 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.379566 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c0acc-370d-4b73-b0da-7c8e6a2da49a None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.405967 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:21.444624 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.445267 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.445545 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.445820 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.446471 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.448504 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.472744 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1302/2591] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:21 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:21.477117 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.492303 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe69e7-6cec-42f0-9847-fc023370a59e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.500625 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.501386 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.501759 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.502122 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.502928 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.505256 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.520342 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1290/2592] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:21.525362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.537353 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69fbe-1b3b-40ec-a292-f7e339bc04dc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.543339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.544061 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.544345 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.544617 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] PATH_INFO: `/v3/projects/da2ccb100500436a89c6b7f6c927e0b5/users/fee5f9cb969b496787a95cef26437caf/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.561948 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2ccb100500436a89c6b7f6c927e0b5, user_id=fee5f9cb969b496787a95cef26437caf, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.565092 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.581756 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1303/2593] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:21 2022] PUT /identity/v3/projects/da2ccb100500436a89c6b7f6c927e0b5/users/fee5f9cb969b496787a95cef26437caf/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:21.585953 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.597443 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd80f-11a2-42b4-891d-3347793327cf admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.667975 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.668626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.668903 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.669235 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.669878 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.671617 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e7f1e-ce29-4d2f-a72e-1748d071397c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.682016 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1291/2594] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:21.686770 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.698916 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3390743-47ad-4bbe-aea7-35305fcc2e6f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.704780 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.705455 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.705738 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.706010 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] PATH_INFO: `/v3/projects/da2ccb100500436a89c6b7f6c927e0b5/users/fee5f9cb969b496787a95cef26437caf/roles/19608e06d1c94b169326bd0a33985478` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.708248 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2ccb100500436a89c6b7f6c927e0b5, user_id=fee5f9cb969b496787a95cef26437caf, role_id=19608e06d1c94b169326bd0a33985478)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:21.710981 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:21.727561 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1304/2595] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:21 2022] PUT /identity/v3/projects/da2ccb100500436a89c6b7f6c927e0b5/users/fee5f9cb969b496787a95cef26437caf/roles/19608e06d1c94b169326bd0a33985478 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:21.738493 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.739090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.739090 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:21.769883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] MFA Rules not processed for user `fee5f9cb969b496787a95cef26437caf`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:21.771439 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:21.853197 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1292/2596] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:21.864362 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:21.867301 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:21.942005 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285726-a850-4730-a98a-607720f568a8 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:21.946339 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:21.946939 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:21.947199 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:21.947482 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:22.012745 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:22.014180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:22.024728 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1305/2597] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:26.392654 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:26.394491 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:26.408881 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab9ea-f5d3-46ea-adc8-8cc58aebecf9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:26.413062 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:26.413670 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:26.413941 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:26.414192 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:26.424549 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:26.426675 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feaed-6645-4616-8794-d357467a420b service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:26.440612 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1293/2598] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:31.442578 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:31.482550 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:31.516080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e373011-9026-41ed-be38-d65b1642908c service cinder] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:31.521842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:31.522494 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:31.522781 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:31.523049 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] PATH_INFO: `/v3/users/f90152a6df85483a923af7370362c5f6` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:31.524236 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90152a6df85483a923af7370362c5f6)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:31.526291 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:31.590219 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90152a6df85483a923af7370362c5f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:31.597694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90152a6df85483a923af7370362c5f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:31.598505 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90152a6df85483a923af7370362c5f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:31.599118 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90152a6df85483a923af7370362c5f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:31.609284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90152a6df85483a923af7370362c5f6'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:31.632973 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1306/2599] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:31 2022] DELETE /identity/v3/users/f90152a6df85483a923af7370362c5f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:31.637905 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64edbb-6959-4214-980f-059893124f62 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:31.638454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64edbb-6959-4214-980f-059893124f62 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:31.638454 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64edbb-6959-4214-980f-059893124f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:31.659895 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-8e64edbb-6959-4214-980f-059893124f62 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:31.661687 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e64edbb-6959-4214-980f-059893124f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:31.688972 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:31.735626 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1294/2600] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:31.746312 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:31.747827 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:31.815255 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5d47-4b50-4fdb-85d8-4e881e2684cc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:31.820390 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:31.821009 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:31.821284 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:31.821554 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:31.831710 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:31.833319 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:31.842947 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1307/2601] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:32.143231 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64edbb-6959-4214-980f-059893124f62 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:32.145690 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-8e64edbb-6959-4214-980f-059893124f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:32.159949 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64edbb-6959-4214-980f-059893124f62 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:32.166619 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:32.167277 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:32.167553 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:32.167896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] PATH_INFO: `/v3/projects/4fd9c9b765494e2aac498ebd6c915ed7` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:32.169338 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd9c9b765494e2aac498ebd6c915ed7)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:32.171304 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:32.221817 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd9c9b765494e2aac498ebd6c915ed7', 'request_id': 'req-643e0b08-c369-43c7-b56a-7075d04400c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.231239 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd9c9b765494e2aac498ebd6c915ed7', 'request_id': 'req-643e0b08-c369-43c7-b56a-7075d04400c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.238286 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd9c9b765494e2aac498ebd6c915ed7', 'request_id': 'req-643e0b08-c369-43c7-b56a-7075d04400c6'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.249086 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] The token cache is being invalidate because project 4fd9c9b765494e2aac498ebd6c915ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:32.249376 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.250012 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.251610 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1295/2602] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:32 2022] DELETE /identity/v3/projects/4fd9c9b765494e2aac498ebd6c915ed7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:32.256058 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:32.266723 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcfffd-1290-461d-8147-2374fdaa98ed service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:32.318946 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:32.328551 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:32.329462 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:32.329836 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:32.330112 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] PATH_INFO: `/v3/users/fee5f9cb969b496787a95cef26437caf` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:32.331365 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee5f9cb969b496787a95cef26437caf)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:32.333882 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:32.388158 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee5f9cb969b496787a95cef26437caf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.396209 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee5f9cb969b496787a95cef26437caf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.396921 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee5f9cb969b496787a95cef26437caf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.397541 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee5f9cb969b496787a95cef26437caf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.409804 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-94cd4bc5-8197-4f52-9d9d-64eef126c3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee5f9cb969b496787a95cef26437caf'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.429897 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1308/2603] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:32 2022] DELETE /identity/v3/users/fee5f9cb969b496787a95cef26437caf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 13:59:32.740101 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:32.741780 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:32.755945 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0b08-c369-43c7-b56a-7075d04400c6 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:32.823944 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:32.824572 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:32.824850 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:32.825120 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] PATH_INFO: `/v3/projects/da2ccb100500436a89c6b7f6c927e0b5` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:32.826836 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2ccb100500436a89c6b7f6c927e0b5)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:32.829180 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:32.890296 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2ccb100500436a89c6b7f6c927e0b5', 'request_id': 'req-06c77fba-5a8e-410b-bbc5-3048dea77e9c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.893796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:32.901446 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2ccb100500436a89c6b7f6c927e0b5', 'request_id': 'req-06c77fba-5a8e-410b-bbc5-3048dea77e9c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.909673 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2ccb100500436a89c6b7f6c927e0b5', 'request_id': 'req-06c77fba-5a8e-410b-bbc5-3048dea77e9c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.921253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] The token cache is being invalidate because project da2ccb100500436a89c6b7f6c927e0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:32.921571 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.922312 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-06c77fba-5a8e-410b-bbc5-3048dea77e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:32.923883 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1296/2604] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:32 2022] DELETE /identity/v3/projects/da2ccb100500436a89c6b7f6c927e0b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:32.931163 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:32.931694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:32.931694 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:32.953200 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:32.954431 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:33.025605 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1309/2605] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:33.037743 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.038024 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.038299 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.059896 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:33.061414 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:33.070221 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1297/2606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:33.075376 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.092238 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1a93-024a-450b-82f1-9406dfa3c2f2 None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.100344 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.100962 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.101240 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.101486 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] PATH_INFO: `/v3/domains` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.102148 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 13:59:33.102450 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.104080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.116659 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1310/2607] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Oct 15 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 13:59:33.121275 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.131002 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c51a91-7547-4904-b756-02b9ba2c6fe9 None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.137067 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.137719 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.137980 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.138253 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.138876 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.140942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.178665 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1298/2608] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Oct 15 13:59:33 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:33.185211 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.199022 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4b7ad-8f14-40a7-a2ad-e36b167521dc admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.262122 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.262735 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.263015 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.263261 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.263931 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.265873 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.275907 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:33.292401 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1311/2609] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Oct 15 13:59:33 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 13:59:33.296776 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.307628 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780278ec-454d-4058-9e1c-07ffc888cba8 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.313284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.313915 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.314190 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.315820 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.316577 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.318251 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.330655 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1299/2610] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:33.334936 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.345246 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0ade3-d3fa-4c25-8446-6b9caf1dd9f5 admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.351805 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.352699 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.352975 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.353244 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.354180 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.356614 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541537a-d9fa-4c33-8b19-55ad0c689a1d admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.370726 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1312/2611] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Oct 15 13:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 13:59:33.376597 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.387738 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afb769-0561-49c8-bf9b-b55bd1ab7a7e admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.392792 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.393401 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] REQUEST_METHOD: `PUT` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.393674 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.393942 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] PATH_INFO: `/v3/projects/d2b0d425346948388e7e5f67955ea8ba/users/44b2744e824f4127ae2908fa213aef64/roles/f76404c6460e4bef90535587cf1814d1` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.418684 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b0d425346948388e7e5f67955ea8ba, user_id=44b2744e824f4127ae2908fa213aef64, role_id=f76404c6460e4bef90535587cf1814d1)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.422777 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.444627 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1300/2612] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Oct 15 13:59:33 2022] PUT /identity/v3/projects/d2b0d425346948388e7e5f67955ea8ba/users/44b2744e824f4127ae2908fa213aef64/roles/f76404c6460e4bef90535587cf1814d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:33.458279 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] REQUEST_METHOD: `POST` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.458570 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.458842 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.491955 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.auth.core [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] MFA Rules not processed for user `44b2744e824f4127ae2908fa213aef64`. Rule list: `[]` (Enabled: `True`). {{(pid=87877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:33.493607 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:33.580926 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1313/2613] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:33.600284 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:33.602425 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:33.684143 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f3608-dfe6-45c9-a0bc-4f6dd6931574 admin admin] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:33.689279 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb1ad7b1aec4c5f99b1341e62d18c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:33.689914 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:33.690272 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:33.690796 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:33.702064 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:33.703526 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24216f-6aea-4dad-95bb-cf837d31f6f4 service cinder] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:33.714904 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1301/2614] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:36.378872 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:36.458230 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81a023-d4ca-451e-a0ca-ec60ba50f3ac None None] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:36.467661 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:36.468352 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:36.468625 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:36.468900 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] PATH_INFO: `/v3/users/44b2744e824f4127ae2908fa213aef64` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:36.470103 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b2744e824f4127ae2908fa213aef64)` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:36.472110 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:36.523461 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b2744e824f4127ae2908fa213aef64'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:36.530923 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b2744e824f4127ae2908fa213aef64'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:36.531670 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b2744e824f4127ae2908fa213aef64'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:36.532358 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b2744e824f4127ae2908fa213aef64'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:36.541435 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.notifications [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b2744e824f4127ae2908fa213aef64'} {{(pid=87877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:36.551671 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:36.566159 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1314/2615] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Oct 15 13:59:36 2022] DELETE /identity/v3/users/44b2744e824f4127ae2908fa213aef64 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:36.571503 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] REQUEST_METHOD: `POST` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:36.572149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:36.572149 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:36.594658 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.auth.core [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] MFA Rules not processed for user `ddbeecebab3748e2bb0c6f73045e40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 13:59:36.595931 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:36.665445 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1302/2616] 10.222.0.33 () {58 vars in 958 bytes} [Sat Oct 15 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 13:59:36.675922 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:36.677857 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:36.761610 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4124ef-7671-4e34-9f3e-24ceb273427f admin admin] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:36.765791 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff73b0ad3ad44b4bb9d60912e0bbd62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:36.766405 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:36.766680 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:36.767036 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:36.778014 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:36.779459 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:36.789650 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1315/2617] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 13:59:37.074541 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] Authenticating user token {{(pid=87878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 13:59:37.076232 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.fernet_utils [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 13:59:37.089879 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a0fd-38fb-46ea-9ce3-ebf9b0220a2f None None] Validating token access rules against request {{(pid=87878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 13:59:37.095287 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddbeecebab3748e2bb0c6f73045e40dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccefdcbe08cc44feb4368c7ef30d7a4d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 13:59:37.096026 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 13:59:37.096306 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 13:59:37.096575 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] PATH_INFO: `/v3/projects/d2b0d425346948388e7e5f67955ea8ba` {{(pid=87878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 13:59:37.097798 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b0d425346948388e7e5f67955ea8ba)` {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 13:59:37.099870 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] RBAC: Authorization granted {{(pid=87878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 13:59:37.117532 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:37.150602 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b0d425346948388e7e5f67955ea8ba', 'request_id': 'req-42ea2de7-ebc4-4db7-858e-6351270a3e1c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:37.160230 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b0d425346948388e7e5f67955ea8ba', 'request_id': 'req-42ea2de7-ebc4-4db7-858e-6351270a3e1c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:37.167343 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b0d425346948388e7e5f67955ea8ba', 'request_id': 'req-42ea2de7-ebc4-4db7-858e-6351270a3e1c'} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:37.178502 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] The token cache is being invalidate because project d2b0d425346948388e7e5f67955ea8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 13:59:37.178789 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:37.179423 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG keystone.notifications [None req-42ea2de7-ebc4-4db7-858e-6351270a3e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 13:59:37.180950 dv-cinder-861491-3-smb devstack@keystone.service[87878]: [pid: 87878|app: 0|req: 1303/2618] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Oct 15 13:59:37 2022] DELETE /identity/v3/projects/d2b0d425346948388e7e5f67955ea8ba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 13:59:46.785183 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=30,keystone:DELETE=1 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:47.175352 dv-cinder-861491-3-smb devstack@keystone.service[87878]: DEBUG dbcounter [-] [87878] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:47.385336 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] Authenticating user token {{(pid=87877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 14:01:47.387316 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 14:01:47.468048 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfd6e8-5da9-4392-b849-cd4ec45d3533 service neutron] Validating token access rules against request {{(pid=87877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 14:01:47.536425 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef5b10788f64f30b4f45955e78b6618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70202ac262c43f887223a279615a5ea', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 14:01:47.537080 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] REQUEST_METHOD: `GET` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 14:01:47.537532 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] SCRIPT_NAME: `/identity` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 14:01:47.537679 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 14:01:47.539766 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.fernet_utils [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 14:01:47.551860 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 14:01:47.553446 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9e155-a0f2-4f62-912c-0bd6c7395321 service placement] RBAC: Authorization granted {{(pid=87877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 14:01:47.568382 dv-cinder-861491-3-smb devstack@keystone.service[87877]: [pid: 87877|app: 0|req: 1316/2619] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Oct 15 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 14:01:57.560581 dv-cinder-861491-3-smb devstack@keystone.service[87877]: DEBUG dbcounter [-] [87877] Writing DB stats keystone:SELECT=58 {{(pid=87877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}